Data Engineer: Spark and Databricks Expert
4 weeks ago
Job Title: Data Engineer: Spark and Databricks Expert
About the Role:
We are seeking a highly skilled Data Engineer with expertise in Spark and Databricks to join our team at Travash. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines using Databricks and Spark, as well as other cloud technologies as needed.
Responsibilities:
- Design and develop data pipelines using Databricks and Spark
- Optimize data pipelines for performance, scalability, and reliability
- Ensure data quality and integrity throughout the data lifecycle
- Collaborate with data scientists, analysts, and other stakeholders to understand and meet their data needs
- Troubleshoot and resolve data-related issues and provide root cause analysis and recommendations
- Document data pipeline specifications, requirements, and enhancements and communicate them effectively to the team and management
- Create new data validation methods and data analysis tools and share best practices and learnings with the data engineering community
- Implement ETL processes and data warehouse solutions and ensure compliance with data governance and security policies
Qualifications:
- Bachelor's degree in computer science, engineering, or related field or equivalent work experience
- 5 years of experience in data engineering, preferably with Databricks and Spark
- Proficient in SQL and Python and familiar with Java or Scala
- Experience with cloud platforms such as Azure or AWS
- Experience with big data technologies such as Kafka, Hadoop, Hive, etc.
-
Hyderabad, Telangana, India AIonOS Full timeWe are seeking an experienced Databricks expert to lead our data engineering practice and drive business growth. As a key member of our team, you will be responsible for developing and implementing large-scale data processing solutions using Databricks technologies.Key Responsibilities:Lead the development of service offerings and methodologies tailored to...
-
Azure Databricks Data Engineer Lead
1 month ago
Hyderabad, Telangana, India Alignity Solutions Full timeAbout the RoleWe are seeking a skilled Azure Databricks Data Engineer to join our team at Alignity Solutions. The ideal candidate will have experience in designing, developing, and maintaining data pipelines and data streams using Databricks, SQL, PySpark, Spark, Python, and Azure Data Factory (ADF).The successful candidate will be responsible for designing...
-
Hyderabad, Telangana, India Reveille Technologies Full timeJob Title: Data Modeling Expert for Azure and Databricks\About the Role:We are seeking a highly skilled Data Modeler to join our team at Reveille Technologies. This is an exciting opportunity to work on designing, implementing, and maintaining data models that support data quality, performance, and scalability.\Key Responsibilities:Designing and implementing...
-
Data Engineering Practice Lead
20 minutes ago
Hyderabad, Telangana, India Recro Full timeData Engineering Practice Lead - Databricks We are seeking a visionary leader to drive innovation and growth in our Databricks practice. As the Data Engineering Practice Lead, you will be responsible for developing and expanding our Databricks capabilities, delivering cutting-edge data solutions, and driving impactful customer engagements.About the RoleThis...
-
Data Engineering Practice Lead
43 minutes ago
Hyderabad, Telangana, India Recro Full timeWe are seeking a visionary Data Engineer to lead our Databricks practice and drive data engineering innovation.About the RoleAs a Data Engineering Practice Lead, you will be responsible for developing and expanding our Databricks practice, crafting methodologies, best practices, and service offerings tailored to client needs.You will oversee multiple...
-
Senior Data Architect
4 weeks ago
Hyderabad, Telangana, India TechVedika Full timeAt Tech Vedika, we are seeking a highly skilled Senior Data Architect to lead our Databricks initiatives. This role requires expertise in designing and implementing scalable data architectures, including Data Lakes, Lakehouses, and Data Warehouses.Key Responsibilities:· Serve as the subject matter expert for all Databricks-related activities, including...
-
Databricks Practice Lead
6 days ago
Hyderabad, Telangana, India Recro Full timeAbout the RoleWe are seeking a dynamic and visionary Databricks Data Engineering Practice Lead to build and grow our Databricks practice, delivering cutting-edge data solutions and driving impactful customer engagements.Key Responsibilities:Develop and expand our Databricks practice, crafting methodologies and best practices tailored to client needs.Oversee...
-
Azure Databricks Data Engineer
1 month ago
Hyderabad, Telangana, India Alignity Solutions Full timeAbout the RoleWe are seeking a skilled Azure Databricks Data Engineer to join our team at Alignity Solutions.The ideal candidate will have experience in designing, developing, and maintaining data pipelines and data streams using Databricks, SQL, PySpark, Spark, Python, and Azure Data Factory (ADF).Responsibilities include:Designing and building modern data...
-
Data Engineering Practice Lead
1 week ago
Hyderabad, Telangana, India Recro Full timeAbout the OpportunityAre you ready to drive data engineering innovation and lead the way in delivering cutting-edge solutions? We are seeking a dynamic and visionary Databricks Data Engineering Practice Lead to build and grow our Databricks practice, craft methodologies, best practices, and service offerings tailored to client needs.The RoleWe're looking for...
-
Data Engineering Expert for Azure Ecosystem
1 week ago
Hyderabad, Telangana, India Clean Harbors Full timeClean Harbors is seeking a highly skilled Data Engineer to join our team. As an expert in the Azure ecosystem, you will be responsible for designing, implementing, and managing data solutions on Microsoft Azure.We are looking for a talented professional with 5+ years of experience in data engineering, leveraging technologies such as Azure Data Factory, Azure...
-
Databricks Technical Lead
1 month ago
Hyderabad, Telangana, India TechVedika Full timeJob Summary:We're seeking a seasoned Databricks Technical Lead to oversee the development and implementation of our data engineering strategies on the Databricks platform. As a key member of our team, you will be responsible for designing, building, and maintaining scalable data architectures, ensuring seamless data integration and processing.Key...
-
Senior Data Engineering Expert
6 days ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeJob OverviewA challenging opportunity exists for a skilled Senior Data Engineering Expert to join our team at Tata Consultancy Services. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems to meet the business needs of our clients.Estimated Salary Range: ₹40,00,000 -...
-
Data Engineer
2 days ago
Hyderabad, Telangana, India Charter Global Full timeJob Title: Data Engineer - Expert in Data Pipelines">About Charter Global:">We are a leading global company that offers innovative solutions for businesses of all sizes.Salary: The estimated annual salary for this role is ₹2,300,000 - ₹4,200,000 based on the location and industry standards in Hyderabad.Company Overview:">Charter Global is a...
-
Cloud Data Engineering Specialist
2 weeks ago
Hyderabad, Telangana, India UnitedHealth Group Full timeOptum, a global healthcare company, offers an exciting opportunity for a Cloud Data Engineering Specialist to join their team. With the aim of improving health outcomes by connecting people with care, pharmacy benefits, data, and resources, Optum is committed to advancing health equity on a global scale.Primary Responsibilities:Evaluate, design, develop,...
-
Data Analytics Expert
1 week ago
Hyderabad, Telangana, India Genpact Full timeJob DescriptionGenpact, a global professional services and solutions firm, is seeking a talented Data Analytics Expert to join our team. As a key member of the data integrity/analysis team in the Banking and financial domain, you will be responsible for independently building data analysis around complex business problems from data available in client-owned...
-
Senior Data Architect
3 weeks ago
Hyderabad, Telangana, India UnitedHealth Group Full timeAbout UnitedHealth Group UnitedHealth Group is a global organization that delivers care, aided by technology to help millions of people live healthier lives. Our mission is to help people live healthier lives and make the health system work better for everyone. Job Summary We are seeking an experienced Senior Data Architect to lead our team in designing and...
-
Hyderabad, Telangana, India FedEx ACC Full timeJob DescriptionWe are seeking a highly skilled Data Engineer to join our team at FedEx ACC. This is a critical role that requires expertise in designing, developing, and deploying large-scale data engineering solutions.Key Responsibilities:Design, develop, and deploy scalable data pipelines using Azure tools such as Data Factory, DataFlow, Databricks, and...
-
Senior Data Engineer
1 month ago
Hyderabad, Telangana, India Milestone Technologies, Inc. Full timeData Engineering Role at Milestone Technologies, Inc.The Senior Data Engineer will lead the development of scalable data solutions across batch and streaming platforms, utilizing cloud technologies such as AWS or similar to meet business and technical demands. Key responsibilities include analyzing complex data elements and systems, crafting and peer...
-
Data Engineering Innovation Leader
6 days ago
Hyderabad, Telangana, India Recro Full timeWe are seeking a seasoned Data Engineer to lead our Databricks practice, driving cutting-edge data solutions and impactful customer engagements.About the RoleLead & Grow: Develop and expand our Databricks practice, crafting methodologies, best practices, and service offerings tailored to client needs.Deliver Excellence: Oversee multiple customer projects,...
-
Data Engineering Specialist
3 weeks ago
Hyderabad, Telangana, India myGwork Full timeJob OverviewThe role of Data Engineering Specialist is a unique opportunity to drive the development and implementation of data validation frameworks, ensuring high-quality data across various datasets.About Warner Bros. DiscoveryWarner Bros. Discovery is a global media and entertainment company that offers a diverse portfolio of content, brands, and...