
Data Engineering Expert
5 days ago
Job Title: Data Engineering Expert
DescriptionWe are seeking a seasoned professional to assume a leadership role in our data engineering team. The successful candidate will be responsible for designing and implementing cutting-edge data processing pipelines that drive business value.
Key Responsibilities:
- Develop and manage robust ETL pipelines using Apache Spark (Scala)
- Understand Spark concepts, performance optimization techniques, and governance tools
- Design and implement highly scalable, reliable, and high-performance data processing pipelines
- Collaborate with cross-functional teams to design effective data solutions
- Implement data workflows utilizing AWS Step Functions or Azure Logic Apps for efficient orchestration
- Monitor, troubleshoot, and optimize pipeline performance and data quality
- Maintain high coding standards and produce thorough documentation
Technical Requirements:
- Minimum 7 years of progressive experience building solutions in Big Data environments
- Strong ability to build robust and resilient data pipelines which are scalable, fault tolerant, and reliable in terms of data movement
- 3+ years of hands-on expertise in Python, Spark, and Kafka
- Strong command of AWS or Azure services
- Strong hands-on capabilities on SQL and NoSQL technologies
- Solid understanding of data warehousing, modeling, and ETL concepts
- Familiarity with High-Level Design (HLD) and Low-Level Design (LLD) principles
- Excellent written and verbal communication skills
Candidates should possess strong problem-solving skills, excellent analytical abilities, and the capacity to work effectively in a dynamic environment.
-
Azure Data Engineer
3 days ago
Pune, Maharashtra, India Capgemini Engineering Full time ₹ 15,00,000 - ₹ 28,00,000 per yearAt Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...
-
Data Engineering Expert
5 days ago
Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000Job Title: Data Engineering ExpertJob DescriptionWe are seeking a skilled Data Engineering Expert to join our team. The ideal candidate will have experience in designing, building, and maintaining large-scale data systems using Azure Databricks, PySpark, and Apache Spark.The successful candidate will be responsible for developing and optimizing ETL/ELT...
-
Data Engineer
8 hours ago
Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per yearAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...
-
Data Engineer
5 days ago
Pune, Maharashtra, India Jash Data Sciences Full time ₹ 8,00,000 - ₹ 12,00,000 per yearDo you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...
-
Data Engineering Expert
6 days ago
Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 24,50,000Job Title: Data Engineering ExpertWe are seeking a seasoned Data Engineering Expert with extensive experience in designing, building, and optimizing data pipelines and ETL processes in Azure Databricks.The ideal candidate will have a strong background in SQL, Python, and PySpark, as well as a solid understanding of delta tables, Apache Spark, and Unity...
-
Expert Data Engineer
6 days ago
Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000Job Title: Data Engineering ExpertWe are seeking an experienced Data Engineering Expert to join our team.The ideal candidate will have a deep understanding of data engineering principles and practices, with expertise in designing and implementing robust data pipelines using Databricks, PySpark, and SQL.This role requires the ability to work independently in...
-
Data Engineering Expert
1 week ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,20,00,000Data Engineering Expert WantedWe are seeking a skilled Data Engineer to join our engineering team for an international enterprise.This is a 6-month full-time contract opportunity that requires the candidate to have strong expertise in data engineering and experience with Palantir Foundry, PySpark, and TypeScript.Palantir Foundry /...
-
Expert Data Engineer
1 week ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,50,000Data Engineering Expert WantedWe are seeking a highly skilled and experienced professional to lead our data engineering efforts.Responsibilities:Design, develop, and maintain large-scale data systems using Python and PySpark.Create complex SQL queries for data transformation, validation, and analysis.BUILD scalable, reusable code frameworks with a dynamic...
-
Data Engineering Expert
7 hours ago
Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000About this RoleWe are seeking a seasoned Data Engineering Expert to help a leading financial institution modernize their platform.Main Responsibilities:Design and deploy data pipelines using GCP servicesOrchestrate workflows using Apache AirflowProcess and transform data using Pyspark, Dataflows, and DataprocManage datasets and integrate with various APIs...
-
Expert Data Integration Engineer
3 days ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000About This RoleWe are seeking an experienced ETL expert to lead the design and development of data integration and analytics solutions using the Snowflake platform.This key member of our data engineering team will be responsible for creating efficient and scalable ETL processes, ensuring data quality and consistency, and collaborating with stakeholders to...