Databricks Data Engineer
1 day ago
Position Overview
We are seeking an experienced Data Engineer with strong expertise in Databricks, Azure Data Services ecosystem (ADF, ADLS, Microsoft Fabric, Synapse, etc.), Python, PySpark, and databases. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and solutions to enable advanced analytics, business intelligence, and AI-driven initiatives.
Key Responsibilities
- Design, develop, and maintain data pipelines using Azure Data Factory (ADF) and Databricks.
- Work with Azure Data Lake Storage (ADLS), Microsoft Fabric, and Azure Synapse Analytics to build robust data platforms.
- Develop scalable ETL/ELT solutions leveraging Python, PySpark, and SQL.
- Optimize data workflows for performance, reliability, and cost efficiency.
- Collaborate with data scientists, analysts, and business teams to ensure data availability and quality.
- Implement best practices for data governance, security, and compliance in the Azure ecosystem.
- Monitor, troubleshoot, and enhance data processes and pipelines in production environments.
- Stay current with evolving Azure cloud technologies, big data frameworks, and modern data architectures.
Required Skills & Qualifications
- Strong experience with Azure Data Services:
- Azure Data Factory (ADF)
- Azure Data Lake Storage (ADLS)
- Microsoft Fabric (nice-to-have but preferred)
- Azure Synapse Analytics
- Expertise in Databricks for data engineering and analytics.
- Proficiency in Python and PySpark for large-scale data processing.
- Strong knowledge of SQL and relational/non-relational databases.
- Experience with data modeling, ETL/ELT pipelines, and data warehousing concepts.
- Understanding of CI/CD, version control (Git), and DevOps practices.
- Excellent problem-solving, communication, and collaboration skills.
Preferred Qualifications
- Experience with data governance frameworks and security best practices in Azure.
- Knowledge of machine learning integration within Databricks.
- Familiarity with Power BI or other visualization tools.
- Prior experience in agile environments.
Education & Experience
- Bachelor's or Master's degree in Computer Science, Information Systems, Data Engineering, or related field.
- 3+ years of professional experience in data engineering or big data roles.
Job Type: Contractual / Temporary
Contract length: 6 months
Pay: ₹600, ₹800,000.00 per year
Work Location: In person
-
Databricks Engineer
7 days ago
Hyderabad, Telangana, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDesign, build, and maintain robust ETL/ELT data pipelines using Apache Spark on Databricks. Implement data Lakehouse architecture using Delta Lake for cost-effective data storage and analytics. Use Databricks Workflows for orchestrating batch and streaming pipelines. Develop and maintain CI/CD pipelines for data applications using tools such as Azure DevOps,...
-
Databricks Engineer
2 days ago
Hyderabad, Telangana, India NTT DATA Business Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRoles and ResponsibilitiesDesign, develop, test, deploy, and maintain large-scale data pipelines using Apache Spark, Delta Lake, ETL processes.Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions on time.Develop complex SQL queries to optimize database performance and troubleshoot issues.Ensure scalability,...
-
DataBricks - Data Engineering
3 days ago
Hyderabad, Telangana, India Wipro Full time ₹ 15,00,000 - ₹ 30,00,000 per yearWipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest...
-
Senior Data Engineer/Architect
2 weeks ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per yearExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, Spark,Copilot Studio , Databricks Lakehouse Platform, its architecture, and its capabilities.Notice Period : Immediate Joiners/ Permanent/Contract role (Can join within 15th September...
-
Data Engineer – Databricks Platform
2 weeks ago
Hyderabad, Telangana, India Cropboy solutions Full time ₹ 1,80,000 - ₹ 18,00,000 per yearPosition OverviewWe are looking for an experienced Data Engineer to design and implement a scalable data platform using Databricks. The ideal candidate will have strong expertise in building modern data architectures, integrating diverse data sources (SQL Server, MongoDB, InfluxDB), and enabling analytics and reporting use cases.Key Responsibilities●...
-
Databricks Engineer
2 weeks ago
Hyderabad, Telangana, India ValueMomentum Full time ₹ 9,00,000 - ₹ 12,00,000 per yearCompany DescriptionValueMomentum is a leading solutions provider for the global property and casualty insurance industry, backed by deep domain and technology capabilities. Our mission is to help insurers achieve sustained growth and high performance by enhancing stakeholder value and building resilient societies. Trusted by over 100 insurers globally, we...
-
Databricks Engineer
3 days ago
Hyderabad, Telangana, India Stanra Tech Solutions Full time ₹ 10,00,000 - ₹ 25,00,000 per yearWe are looking for a skilled and experienced Databricks Engineer to join our team at our Hyderabad (Madhapur) office. The ideal candidate will have a strong background in data engineering, hands-on experience with Databricks, and a solid understanding of cloud platforms (AWS, Azure, or GCP). This is a great opportunity to work on cutting-edge data projects...
-
Sr. Data Engineer – AWS Databricks
2 weeks ago
Hyderabad, Telangana, India Gravity Infosolutions, Inc. Full time ₹ 8,00,000 - ₹ 12,00,000 per yearSr. Data Engineer – AWS Databricks / Data Tech LeadType: ContractLocation : Chennai / HydExperience: 5+ yearsDuration: 3 Months+ ExtendableKey ResponsibilitiesData Pipeline Development: Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently.Manage job orchestration,...
-
Senior Data Engineer
1 week ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per yearExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)Translate business rules into technical specifications and implement scalable data solutions.Manage a...
-
AWS-Databricks Engineer
1 week ago
Hyderabad, Telangana, India Coforge Full time ₹ 8,00,000 - ₹ 24,00,000 per yearWe are seeking an experiencedAWS Databricks Developerto design, develop, and maintain scalable data processing and analytics solutions on theAWS and Databricksplatform. The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.Key...