Databricks Developer

3 days ago

Chennai, India Tekskills Full time

Job Description:
• Data Pipeline Design: Architect and implement scalable, reliable data pipelines using Databricks, Spark, and Delta Lake
• Medallion Architecture Implementation: Ingest raw data into the Bronze layer, process and clean it in the Silver layer, and aggregate/transform it for analytics in the Gold layer
• Data Modeling: Design and optimize data models for efficient storage, retrieval, and analytics
• Data Quality & Security: Implement data validation, quality checks, and security controls throughout the pipeline
• Automation & Monitoring: Automate pipeline execution, monitor performance, and troubleshoot issues
• Collaboration: Work closely with data scientists, analysts, and business stakeholders to deliver high-quality, analytics-ready data

Essential Skills:
• Databricks Certified Associate Developer for Apache Spark (or equivalent)
• Strong Python/Scala for Spark development
• Experience with Delta Lake and Spark DataFrame API
• Proven experience migrating from Cloudera to Databricks
• Data pipeline orchestration (Databricks Jobs, Airflow, etc.)
• Data quality and security best practices

Desirable Skills:
• Databricks Certified Data Engineer Associate
• SQL and advanced query optimization
• Cloud platforms (Azure, AWS, GCP)
• Real-time/streaming data processing (Spark Structured Streaming)
• DevOps/MLOps (CI/CD, Docker, Kubernetes)
• Experience with data governance and lineage tools

  • Databricks Developers

    3 days ago

    Chennai, India Cynosure Corporate Solutions Full time

    Key Responsibilities: Develop and optimize data pipelines in Databricks for transforming and processing data from various sources. Integrate data using Unity Catalog and external data sources (data lakes, APIs, etc.). Write Spark SQL and PySpark scripts for data transformations, optimizations, and creating views/procedures. Perform data analysis to identify...

  • Databricks Developer

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 35,00,000

    Senior Data Engineer RoleWe are seeking a highly skilled Senior Data Engineer to join our team. As a key contributor, you will be responsible for designing, developing, and deploying scalable data pipelines and ETL processes using Databricks.Key ResponsibilitiesDesign and develop efficient data pipelines and workflows in Databricks.Optimize Spark jobs to...

  • Databricks Developer

    3 days ago

    Chennai, India VySystems Full time

    Job Title: Databricks Developer Notice Period: Immediate to 15 Days Location: Pan India (Remote) Experiences: 5 to 9 Years Job Summary We are seeking a highly skilledDatabricks Developerwith expertise inPython, PySpark, API Design, Azure, Airflow, and SQL. The ideal candidate will design, build, and optimize large-scale data processing solutions, ensuring...

  • Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Job SummaryJoin our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly...

  • Databricks

    3 days ago

    Chennai, India Cognizant Technology Solutions Full time

    Job Summary Join our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly...

  • Databricks Developer

    3 days ago

    Chennai, India Ignitho Full time

    Job Title: Databricks Developer Experience: 2 to 4 Years Job Summary We are seeking a skilled Databricks Developer with 2 to 4 years of experience to design and implement scalable, high-performance data solutions across cloud and on-premise environments. The ideal candidate will have hands-on experience in data modeling, SQL development, and ETL processes,...

  • Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** **Responsibilities** - Lead the design and implementation of data processing pipelines using Spark in Scala and PySpark - Oversee the administration of Databricks Unity Catalog and manage data governance - Provide expertise in Delta Sharing and ensure secure data sharing practices - Develop and maintain Databricks CLI scripts for automation...

  • Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** Join our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will...

  • Databricks Architect

    3 weeks ago

    Chennai, Tamil Nadu, India Datacrew Full time

    Job Title: Senior Databricks Data Engineer/Databricks ArchitectExperience: 5-8 yearsLocation: Chennai / Oman (Onsite)Note: Initial onsite for 3 months at Oman and back to Chennai to work from OffshoreEmployment Type: ContractRole Summary:The Databricks Architect will be responsible for designing, implementing, and optimizing scalable data architectures...

  • Azure Databricks Developer

    1 week ago

    Chennai, Coimbatore, Kolkata, India Ltimindtree Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Mandate Skills: Databricks, Datafactory, Pyspark, SQLResponsibility:5+ Years of experience using Azure.Strong proficiency in Databricks.Experience with Pyspark.Proficiency in SQL or TSQL.Experience in Azure service components like Azure data factory, Azure data lake, Databricks, SQL DB SQL Server.Databricks Jobs for efficient data processing ETL tasks and...