Lead Data Engineer
3 days ago
Job Description :
- Design, build and maintain highly scalable and available big data solutions on AWS cloud
- Develop and manage AWS Glue data catalog, crawlers, and ETL jobs
- Design and implement data synchronization solutions using AWS Datasync
- Manage and optimize S3 data storage and access patterns
- Develop and maintain Infrastructure as Code (IaC) using Terraform
- Develop and maintain AWS Lambda functions to automate data workflows
- Develop and optimize PySpark and Databricks-based data pipelines and analytics solutions
- Implement and manage Delta tables for data versioning, schema management, and performance optimization
- Understanding of Lakehouse architecture
- Knowledge on Databricks - Unity Catalog, data governance, AWS Tagging
- Write efficient SQL queries to extract insights from big data
- Implement basic DevOps practices, including CI/CD pipelines and Github workflows
- Collaborate with data scientists, data analysts, and other engineers to deliver data-driven solutions
- Keep up-to-date with the latest big data and cloud technologies and proactively apply them to improve our solutions
-
Senior Machine Learning Engineer
2 months ago
Any Location, IN K2 Data & Analytics Full timeJob Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...
-
Senior Machine Learning Engineer
4 weeks ago
Any Location, IN K2 Data & Analytics Full timeJob Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...
-
MLOps Developer
2 months ago
Any Location, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full timeJob Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...
-
MLOps Developer
4 weeks ago
Any Location, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full timeJob Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...
-
Lead Data Scientist
2 weeks ago
Any Location, IN Multplyr Full timeKey Responsibilities :Leadership & Strategy :- Lead the data science team in the research and development of innovative ML, NLP, LLM, and DL solutions.- Develop and execute a strategic roadmap for AI initiatives in alignment with business goals.- Mentor and guide junior data scientists and engineers, fostering a culture of continuous learning and...
-
Senior Data Engineer
1 month ago
Any Location, IN Coders Brain Technology Pvt. Ltd. Full timePosition Name : Sr Data EngineerExperience Required : 8+yearsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :Solution Architect (Databricks) :Candidate having 8+ years of total experience in Data engineering (development/design), in which at least 5+...
-
Senior Data Engineer
4 weeks ago
Any Location, IN Coders Brain Technology Pvt. Ltd. Full timePosition Name : Sr Data EngineerExperience Required : 8+yearsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :Solution Architect (Databricks) :Candidate having 8+ years of total experience in Data engineering (development/design), in which at least 5+...
-
Data Engineer
2 months ago
Any Location, IN Reliable Group Full timePOSITION DESCRIPTION :WHAT YOU'LL DO :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical...
-
Data Engineer
4 weeks ago
Any Location, IN Reliable Group Full timePOSITION DESCRIPTION :WHAT YOU'LL DO :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical...
-
Data Engineer
1 month ago
Any Location, IN Edstem Technologies Full timeRole : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...
-
Data Engineer
4 weeks ago
Any Location, IN Edstem Technologies Full timeRole : Data Engineer Roles : We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer satisfaction and enhance our...
-
Big Data Engineer
2 weeks ago
Any Location, IN Programming.com Full timeJob Title : Big Data EngineerLocation : RemoteAbout Us :We are a leading specializing in software development . Our team is dedicated to leveraging cutting-edge technologies to deliver scalable and efficient solutions to our clients globally.Role Overview :We are seeking a highly skilled Big Data Engineer with a strong background in designing and developing...
-
Senior Data Engineer
4 weeks ago
Any Location, IN UNICO CONNECT PRIVATE LIMITED Full timeJob Description :Key Responsibilities :- Understand the factories , manufacturing process , data availability and avenues for improvement- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.- Define what data is required to create a solution and work with...
-
AWS Data Engineer
3 days ago
Any Location, IN Vision Excel Career Solutions Full timeRole : Data Engineer (AWS)Mandatory :- Experience in Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc, preferably on AWS.- Experience in ingesting batch and streaming data from various data sources.- Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.)- Experience in developing...
-
Any Location, IN Velotio Full timeDescription :Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS, IoT &...
-
Any Location, IN Velotio Full timeDescription :Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS, IoT &...
-
Data Engineer
3 weeks ago
Any Location, IN Infometry Full timeJob Description :We are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives. You will work closely with cross-functional teams to understand business requirements, design...
-
Victrix Systems and Labs
4 weeks ago
Any Location, IN Victrix Systems & Labs Full timeJob Title : GCP Cloud Data EngineerLocation : RemoteExperience : 2 to 7 yearsJob Description :We are seeking a talented Cloud Data Engineer to join our team on a remote basis.The ideal candidate will have a strong background in cloud migration, building ETL pipelines, data integrations, and the development of Operational Data Stores (ODS) and Data Warehouses...
-
Victrix Systems and Labs
2 months ago
Any Location, IN Victrix Systems & Labs Full timeJob Title : GCP Cloud Data EngineerLocation : RemoteExperience : 2 to 7 yearsJob Description :We are seeking a talented Cloud Data Engineer to join our team on a remote basis.The ideal candidate will have a strong background in cloud migration, building ETL pipelines, data integrations, and the development of Operational Data Stores (ODS) and Data Warehouses...
-
Data Engineer
3 days ago
Any Location, IN Quantumbricks Full timeAbout the Role :We are seeking a highly skilled and experienced Snowflake Data Engineer to join our team and play a crucial role in building and maintaining our data pipelines within the Snowflake cloud data warehouse. You will leverage your in-depth knowledge of Snowflake architecture and strong data engineering skills to design, develop, and optimize...