Senior Databricks Engineer

1 week ago

Chennai, Tamil Nadu, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Experience : 8-15 years.

Primary Roles And Responsibilities :

  • Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack.

  • Ability to provide solutions that are forward-thinking in data engineering and analytics space.

  • Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

  • Triage issues to find gaps in existing pipelines and fix the issues.

  • Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs.

  • Help joiner team members to resolve issues and technical challenges.

  • Drive technical discussion with client architect and team members.

  • Orchestrate the data pipelines in scheduler via Airflow.

Skills And Qualifications :

  • Bachelor's and/or masters degree in computer science or equivalent experience.

  • Must have total 6+ yrs of IT experience and 3+ years' experience in Data warehouse/ETL projects.

  • Deep understanding of Star and Snowflake dimensional modelling.

  • Strong knowledge of Data Management principles.

  • Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture.

  • Should have hands-on experience in SQL, Python and Spark (PySpark).

  • Candidate must have experience in AWS/ Azure stack.

  • Desirable to have ETL with batch and streaming (Kinesis).

  • Experience in building ETL / data warehouse transformation processes.

  • Experience with Apache Kafka for use with streaming data / event-based data.

  • Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala).

  • Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J).

  • Experience working with structured and unstructured data including imaging & geospatial data.

  • Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

  • Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot.

  • Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

  • Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects.

  • Should have experience working in Agile methodology.

  • Strong verbal and written communication skills.

  • Strong analytical and problem-solving skills with a high attention to detail.

  • Senior Data Engineer – Databricks

    22 hours ago

    Chennai, Tamil Nadu, India Zillion Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Senior Data Engineer – DatabricksLocation: Hyderabad/ChennaiWork Schedule: Timings 2:30 PM to 11:30 PMRole Overview:We are seeking a highly skilled Senior Data Engineer with deep expertise in Databricks to design, build, and optimize scalable data pipelines and architectures. You will collaborate with cross-functional teams including data scientists,...

  • Senior Databricks Engineer

    1 week ago

    Chennai, Tamil Nadu, India Tata Consultancy Servicess Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    It will C2H Hiring and Direct payroll with TCS and full time conversion within initial few months.Job Title: Technical LeadWork Location: PAN INDIANotice Period- Immediate Joiner/ 15 DaysSkill Required: Digital : Databricks, Python, SQLExperience Range: 8-10 yearsBudget 17LPAJob Summary:Must have experience as a Tech Lead.Extensive Knowledge in Databricks,...

  • Databrick

    20 hours ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Databricks PySpark and cloud platforms such as Azure or AWS and a strong background in data pipeline development performance optimization and data governance.Key...

  • Data Engineer- Databricks

    19 hours ago

    Chennai, Tamil Nadu, India InfoCepts Full time ₹ 15,00,000 - ₹ 22,00,000 per year

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...

  • Databricks AI Engineer

    2 days ago

    Chennai, Tamil Nadu, India Enoah Isolution Full time ₹ 1,50,00,000 - ₹ 3,00,00,000 per year

    Role & responsibilitiesProgramming & Query Languages: Proficient in Python and SQL for data analysis, modeling, and database management.Machine Learning & AI Models: Experience with regression, decision trees, SVM, deep learning (CNNs, RNNs, Transformers), and advanced AI (GNNs, RL, GANs, LLMs such as GPT-4, Claude, LLaMA).Natural Language & Vision AI:...

  • Senior Data Engineer- Azure Databricks

    1 day ago

    Chennai, Tamil Nadu, India InfoCepts Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position: Data Engineer- Azure DatabricksPurpose of the Position:To design, build, and optimize scalable data pipelines and solutions using Azure Databricks and related technologies, enabling Zodiac Maritime to make faster, data-driven decisions as part of its data transformation journey.Proficiency in data integration techniques, ETL processes and data...

  • Databricks Architect

    2 days ago

    Chennai, Tamil Nadu, India NotionMindz Technology LLP Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role:Databricks ArchitectDesignation:Data ArchitectExperience:7–10 yearsLocation:ChennaiAbout the role:We're looking for aDatabricks Architectto design, build, and optimize data pipelines and large-scale integrations for enterprise-grade data environments. The ideal candidate will bring strong experience inAzure Databricks, Data Factory, and SQL-based data...

  • Data Engineer – Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role Summary:We are looking for aData Engineerwith expertise inAzure Databricks,data transformation, andintegration pipelinesto support forecasting, scheduling, and analytics flows in the WFM Re-Platform program.Key ResponsibilitiesDesign and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems (SAP, PIPS,...

  • Databricks Architect

    7 days ago

    Chennai, Tamil Nadu, India DataTerrain, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Databricks ArchitectExperience: 12+ yearsJob Summary:We are seeking an experienced Databricks Architect to design, implement, and optimize data solutions on the Databricks platform. The ideal candidate will have deep expertise in big data technologies, cloud platforms, and analytics architectures, with strong communication skills to interact...

  • Databricks spark

    7 days ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryThe Sr. Developer role is crucial for driving innovation and efficiency in our hybrid work model. With a focus on Kafka Python Databricks SQL Databricks Workflows and PySpark the candidate will enhance our data processing capabilities. Experience in Claims and Billing domains is advantageous. This position requires 8 to 9 years of experience and...