Databricks Developer
1 week ago
Position: Databricks DeveloperLocation: HyderabadExperience: 5–11 YearsNotice Period: Immediate Joiners PreferredAbout the RoleWe are looking for an experienced Databricks Developer with strong expertise in building scalable data pipelines using Apache Spark, Delta Lake, and cloud-native data platforms. The ideal candidate must have hands-on experience in Databricks development across AWS/Azure/GCP environments.Key ResponsibilitiesDevelop scalable and high-performance data pipelines using Databricks (PySpark/Scala).Implement Delta Lake, optimized storage layers, and advanced Lakehouse architecture.Build batch and streaming ETL/ELT jobs for ingestion, transformation, and enrichment.Create, optimize, and maintain Databricks notebooks, clusters, jobs, and workflows.Work with cloud services such as AWS (Glue, S3), Azure (ADF, Synapse), GCP (BigQuery) depending on project need.Perform data modelling, schema design, and integration with BI/reporting systems.Ensure data quality, reliability, and performance through monitoring and optimization.Collaborate with data engineers, architects, and business teams for end-to-end data delivery.Apply best practices for security, governance, cluster optimization, and cost management within Databricks.Required Technical SkillsHands-on experience with Databricks on AWS / Azure / GCP.Strong expertise in Apache Spark (PySpark / Scala).Experience working with Delta Lake, Delta tables, and Lakehouse architecture.Proficiency in SQL and optimization techniques.Good understanding of ETL/ELT frameworks and pipeline orchestration.Experience with one or more cloud services:AWS: Glue, S3, EMR, LambdaAzure: ADF, Synapse, ADLSGCP: Dataflow, Dataproc, BigQueryKnowledge of version control (Git), CI/CD pipelines.
-
Azure Data Bricks Engineer
2 weeks ago
Patna, Bihar, India CARBYNETECH Full time ₹ 9,00,000 - ₹ 12,00,000 per yearAzure Data Factory: Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows ADF data Ingestion and Integration with other services Azure Databricks: Experience in Big Data components such as Kafka, Spark SQL,...