Senior Databricks Engineer

7 days ago

Chennai, Tamil Nadu, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Experience : 8-15 years.

Primary Roles And Responsibilities :

  • Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack.

  • Ability to provide solutions that are forward-thinking in data engineering and analytics space.

  • Collaborate with DW/BI leads to understand new ETL pipeline development requirements.

  • Triage issues to find gaps in existing pipelines and fix the issues.

  • Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs.

  • Help joiner team members to resolve issues and technical challenges.

  • Drive technical discussion with client architect and team members.

  • Orchestrate the data pipelines in scheduler via Airflow.

Skills And Qualifications :

  • Bachelor's and/or masters degree in computer science or equivalent experience.

  • Must have total 6+ yrs of IT experience and 3+ years' experience in Data warehouse/ETL projects.

  • Deep understanding of Star and Snowflake dimensional modelling.

  • Strong knowledge of Data Management principles.

  • Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture.

  • Should have hands-on experience in SQL, Python and Spark (PySpark).

  • Candidate must have experience in AWS/ Azure stack.

  • Desirable to have ETL with batch and streaming (Kinesis).

  • Experience in building ETL / data warehouse transformation processes.

  • Experience with Apache Kafka for use with streaming data / event-based data.

  • Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala).

  • Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J).

  • Experience working with structured and unstructured data including imaging & geospatial data.

  • Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.

  • Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot.

  • Databricks Certified Data Engineer Associate/Professional Certification (Desirable).

  • Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects.

  • Should have experience working in Agile methodology.

  • Strong verbal and written communication skills.

  • Strong analytical and problem-solving skills with a high attention to detail.

  • Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryJoin our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly...

  • Data Engineer- Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India InfoCepts Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...

  • Databricks Data Engineer

    14 hours ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    About the RoleThe Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations.Experience- 3 to 6 yearsLocation - Kolkata /Chennai/TrivandrumRequired Technical Skill Set ------ Databricks, AWS, Python & PySparkGood to have- Experience in AWS platform (S3, EC2,...

  • Data Engineer – Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role Summary:We are looking for aData Engineerwith expertise inAzure Databricks,data transformation, andintegration pipelinesto support forecasting, scheduling, and analytics flows in the WFM Re-Platform program.Key ResponsibilitiesDesign and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems (SAP, PIPS,...

  • Databricks Architect

    7 days ago

    Chennai, Tamil Nadu, India DataTerrain, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Databricks ArchitectExperience: 12+ yearsJob Summary:We are seeking an experienced Databricks Architect to design, implement, and optimize data solutions on the Databricks platform. The ideal candidate will have deep expertise in big data technologies, cloud platforms, and analytics architectures, with strong communication skills to interact...

  • Databricks spark

    7 days ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryThe Sr. Developer role is crucial for driving innovation and efficiency in our hybrid work model. With a focus on Kafka Python Databricks SQL Databricks Workflows and PySpark the candidate will enhance our data processing capabilities. Experience in Claims and Billing domains is advantageous. This position requires 8 to 9 years of experience and...

  • Senior Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 35,00,000 per year

    Role: Senior Data Engineer (Scala Specialist)Location: ChennaiWork Mode: HybridEmployment Type: Full-time PermanentOverview:We are seeking an experienced Senior Data Engineer with deep expertise in Scala and big data technologies to contribute to a cutting-edge project. This role focuses on designing and implementing high-performance data pipelines and...

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Grethena Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Company Description : Company : Grethena Private Limited. Location : Chennai. Experience : 5 years. Salary : As per market standards. Job Title : Senior Data Engineer. About us : Grethena Shaping The Digital Landspace Our team of experts has years of experience in App, AI, OTT Platform and Booking App Development. We are passionate...

  • Azure Databricks Engineer

    1 week ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor)Required Technical Skill Set**Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd,Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-HaveAzure DevopsAzure Data...

  • Azure Databricks Administrator

    2 weeks ago

    Chennai, Tamil Nadu, India Randomtrees Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Roles and ResponsibilitiesDesign, implement, and maintain Azure Databricks clusters for data engineering workloads.Configure and manage Azure DevOps pipelines for CI/CD processes using Python scripts.Migrate on-premises databases to Azure platforms using Data Bricks migration tools.Troubleshoot issues related to Azure Databricks cluster performance,...