Databricks Developer

1 day ago

Chennai, Tamil Nadu, India Tekskills Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Job Description:

• Data Pipeline Design: Architect and implement scalable, reliable data pipelines using Databricks, Spark, and Delta Lake

• Medallion Architecture Implementation: Ingest raw data into the Bronze layer, process and clean it in the Silver layer, and aggregate/transform it for analytics in the Gold layer

• Data Modeling: Design and optimize data models for efficient storage, retrieval, and analytics

• Data Quality & Security: Implement data validation, quality checks, and security controls throughout the pipeline

• Automation & Monitoring: Automate pipeline execution, monitor performance, and troubleshoot issues

• Collaboration: Work closely with data scientists, analysts, and business stakeholders to deliver high-quality, analytics-ready data

Essential Skills:

• Databricks Certified Associate Developer for Apache Spark (or equivalent)

• Strong Python/Scala for Spark development

• Experience with Delta Lake and Spark DataFrame API

• Proven experience migrating from Cloudera to Databricks

• Data pipeline orchestration (Databricks Jobs, Airflow, etc.)

• Data quality and security best practices

Desirable Skills:

• Databricks Certified Data Engineer Associate

• SQL and advanced query optimization

• Cloud platforms (Azure, AWS, GCP)

• Real-time/streaming data processing (Spark Structured Streaming)

• DevOps/MLOps (CI/CD, Docker, Kubernetes)

• Experience with data governance and lineage tools

  • Databricks Developers

    2 days ago

    Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Key Responsibilities:Develop and optimize data pipelines in Databricks for transforming and processing data from various sources.Integrate data using Unity Catalog and external data sources (data lakes, APIs, etc.).Write Spark SQL and PySpark scripts for data transformations, optimizations, and creating views/procedures.Perform data analysis to identify...

  • Databricks Developer

    2 days ago

    Chennai, Tamil Nadu, India VySystems Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title: Databricks DeveloperNotice Period: Immediate to 15 DaysLocation: Pan India (Remote)Experiences: 5 to 9 YearsJob SummaryWe are seeking a highly skilledDatabricks Developerwith expertise inPython, PySpark, API Design, Azure, Airflow, and SQL. The ideal candidate will design, build, and optimize large-scale data processing solutions, ensuring high...

  • Senior Databricks Developer

    3 days ago

    Chennai, Tamil Nadu, India Genpact Full time ₹ 1,20,000 - ₹ 2,40,000 per year

    Principal Consultant, Sr. Databricks DeveloperPrincipal Consultant, Sr. Databricks Developer-COR Ready to shape the future of work? At Genpact, we don't just adapt to change—we drive it. AI and digital innovation are redefining industries, and we're leading the charge. Genpact's AI Gigafactory, our industry-first accelerator, is an example of how...

  • Databricks spark

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryThe Sr. Developer role is crucial for driving innovation and efficiency in our hybrid work model. With a focus on Kafka Python Databricks SQL Databricks Workflows and PySpark the candidate will enhance our data processing capabilities. Experience in Claims and Billing domains is advantageous. This position requires 8 to 9 years of experience and...

  • Databricks Architect

    2 weeks ago

    Chennai, Tamil Nadu, India DataTerrain, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Databricks ArchitectExperience: 12+ yearsJob Summary:We are seeking an experienced Databricks Architect to design, implement, and optimize data solutions on the Databricks platform. The ideal candidate will have deep expertise in big data technologies, cloud platforms, and analytics architectures, with strong communication skills to interact...

  • Databrick Pyspark

    1 day ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Key Responsibilities:Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...

  • DataBricks / AWS Redshift

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key responsibilities include designing developing and maintaining scalable data pipelines using Apache Spark on Databricks Writing efficient and production ready PySpark or Scala code for data transformation and ETL processes Integrating data from various structured and unstructured sources into a unified platform Implementing Delta Lake and managing data...

  • Databricks Admin

    1 week ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Databricks AdminExp- 5 to 8 yearsLocation- Chennai/ KolkataRequired SkillsDatabricks AdministrationTerraformAWS cloud servicesMLflowWorkflowsDatabricks Asset BundlesAWS IAMVPCPrivate endpointsFirewallsS3SQL + PySparkdbx CLIResponsibilitiesImplement, and maintain the Databricks platform, including workspace setup, user and group management, access control,...

  • Azure Databricks Lead

    5 days ago

    Chennai, Tamil Nadu, India GIG Consultants Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Description : Key Responsibilities : - Lead the design, development, and optimization of large-scale data solutions using Azure Databricks, Azure Data Factory (ADF), and Azure Synapse Analytics. - Architect and implement efficient ETL/ELT pipelines for ingesting, transforming, and processing structured and unstructured data. - Develop...

  • Databricks Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    About the RoleThe Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations.Experience- 3 to 6 yearsLocation - Kolkata /Chennai/TrivandrumRequired Technical Skill Set ------ Databricks, AWS, Python & PySparkGood to have- Experience in AWS platform (S3, EC2,...