Data Engineer
8 hours ago
Data Engineer
Navi Mumbai, MH
Job Description:
As a Senior Data Engineer, you will leverage advanced data engineering techniques and analytics to support business decisions for the client. Your role will involve designing and building robust data pipelines, integrating structured and unstructured data from various sources, and developing tools for data processing and analysis. You will play a pivotal role in managing data infrastructure, optimizing data workflows, and guiding data-driven strategies while working closely with data scientists and other stakeholders.
Experience:
- Proven experience in designing, developing, and implementing comprehensive data engineering solutions using Databricks, specifically for large-scale data processing and integration projects
- Develop scalable streaming and batch solutions using cloud-native components.
- Perform data transformation tasks, including cleansing, aggregation, enrichment, and normalization, utilizing Databricks and related technologies.
- Experience in applying DataOps principles and implementing CI/CD and DevOps practices within data environments to optimize development and deployment workflows.
Technical Skills:
- Expert-level proficiency in Spark Scala, Python, and PySpark.
- In-depth knowledge of data architecture, including Spark Streaming, Spark Core, Spark SQL, and data modeling.
- Hands-on experience with various data management technologies and tools, such as Kafka, StreamSets, and MapReduce.
- Proficient in using advanced analytics and machine learning frameworks, including Apache Spark MLlib, TensorFlow, and PyTorch, to drive data insights and solutions.
Databricks Specific Skills:
- Extensive experience in data migration from on-premises to cloud environments and in implementing data solutions on Databricks across cloud platforms (AWS, Azure, GCP).
- Skilled in designing and executing end-to-end data engineering solutions using Databricks, focusing on large-scale data processing and integration.
- Proven hands-on experience with Databricks administration and operations, including notebooks, clusters, jobs, and data pipelines.
- Experience integrating Databricks with other data tools and platforms to enhance overall data management and analytics capabilities.
Certifications:
- Certification in Databricks Engineering (Professional)
- Microsoft Certified: Azure Data Engineer Associate
- GCP Certified: Professional Google Cloud Certified.
- AWS Certified Solutions Architect Professional
-
Specialist- Data Center Operations
7 days ago
Mumbai, Maharashtra, India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per yearContinue to make an impact with a company that is pushing the boundaries of what is possible. At NTT DATA, we are renowned for our technical excellence, leading innovations, and making a difference for our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can continue to grow, belong, and thrive.Your career here...
-
Site Engineer
7 hours ago
Navi Mumbai, Maharashtra, India M L Labade Engineer Contractor Full time ₹ 1,04,000 - ₹ 1,30,878 per yearRole & responsibilitiesOrganizing materials and ensuring sites are safe and clean.Preparing cost estimates and ensuring appropriate materials and tools are available.Providing technical advice and suggestions for improvement on particular projects.Diagnosing and troubleshooting equipment as required.Negotiating with suppliers and vendors to ensure the best...
-
Data Engineer
3 days ago
Mumbai, Maharashtra, India AMISEQ Full timeData Engineer Navi Mumbai, MH Job Description: As a Senior Data Engineer, you will leverage advanced data engineering techniques and analytics to support business decisions for the client. Your role will involve designing and building robust data pipelines, integrating structured and unstructured data from various sources, and developing tools for data...
-
Networking Manage Service Engineer
8 hours ago
Mumbai, Maharashtra, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Cross...
-
Data Engineer
1 week ago
Mumbai, Maharashtra, India Wealth Management Firm Full timeData Engineer (Python & SQL)My client, a listed wealth management firm, is seeking Data Engineers to design, develop, and optimize scalable data pipelines and models that enable smarter, data-driven decisions. In this role, you'll leverage modern data tools, cloud technologies, and collaborate with cross-functional teams to deliver high-quality and...
-
Specialist - Data Center operations
4 weeks ago
Mumbai, Maharashtra, India NTT DATA, Inc. Full timeJob DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive.Your day at NTT DATAThe...
-
Data Engineer
5 days ago
Mumbai, Maharashtra, India Wealth Management Firm Full timeData Engineer (Python & SQL) My client, a listed wealth management firm, is seeking Data Engineers to design, develop, and optimize scalable data pipelines and models that enable smarter, data-driven decisions. In this role, you'll leverage modern data tools, cloud technologies, and collaborate with cross-functional teams to deliver high-quality and...
-
Data Engineer
3 days ago
Mumbai, Maharashtra, India Wealth Management Firm Full timeData Engineer (Python & SQL) My client, a listed wealth management firm, is seeking Data Engineers to design, develop, and optimize scalable data pipelines and models that enable smarter, data-driven decisions. In this role, you'll leverage modern data tools, cloud technologies, and collaborate with cross-functional teams to deliver high-quality and...
-
Data Engineer
3 days ago
Mumbai, Maharashtra, India Wealth Management Firm Full timeData Engineer (Python & SQL) My client, a listed wealth management firm, is seeking Data Engineers to design, develop, and optimize scalable data pipelines and models that enable smarter, data-driven decisions. In this role, you'll leverage modern data tools, cloud technologies, and collaborate with cross-functional teams to deliver high-quality and...
-
Specialist - Data Center Operations
6 hours ago
Mumbai, Maharashtra, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe role of...