Data Engineer- Databricks

1 day ago

Chennai, Tamil Nadu, India InfoCepts Full time

Position: Data Engineer- Databricks

Purpose of the Position:

Develop, support and steer end-to-end business intelligence using Databricks.

Location: Nagpur/ Pune/ Chennai/ Bangalore

Key Responsibilities:

  • Work with business analysts and data architects to translate requirements into technical implementations.
  • Design, develop, implement, and maintain pyspark code through Databricks UI that enables data and analytics use cases for the client.
  • Code, test, and document new or modified data systems to create robust and scalable applications for data analytics.
  • Dive deep into performance, scalability, capacity, and reliability problems to resolve issues.
  • Take on research projects and POC to improve data processing.

Work and Technical Experience:

Must-Have Skills:

  • 5+ hands on Experience with Databricks and PySpark.
  • Proficiency in SQL and data manipulation skills.
  • Good understanding of data warehousing concepts and technologies.

Good-to-Have Skills:

  • Understanding of Google Pub sub/Kafka/Mongo DB.
  • Familiarity with ETL processes and tools for data extraction, transformation, and loading.
  • Knowledge of cloud platforms like Databricks, Snowflake, Google Cloud.
  • Familiarity with data governance and data quality best practices.

Qualifications:

  • Bachelors degree in computer science, engineering, or related field.
  • Demonstrated continued learning through one or more technical certifications or related methods.
  • 5+ years of relevant experience in Data Engineering
  • Relevant experience in Retail domain.

Qualities:

  • Self-motivated and focused on delivering outcomes for a fast-growing team and firm.
  • Able to communicate persuasively through speaking, writing, and client presentations.

Years Of Exp

5 to 7 years

Location

India

  • Databricks with Data Analyst

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Referral Program Full time

    Role Summary:We are seeking skilled Data Analysts to support Informatica MDM production operations, including data ingestion from Databricks, stewardship console support, and downstream data consumption. The role involves monitoring, troubleshooting, and collaborating with business and engineering teams to ensure data quality and operational continuity.Key...

  • Databricks with Data Analyst

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Role Summary:We are seeking skilled Data Analysts to support Informatica MDM production operations, including data ingestion from Databricks, stewardship console support, and downstream data consumption. The role involves monitoring, troubleshooting, and collaborating with business and engineering teams to ensure data quality and operational continuity.Key...

  • Data Engineer

    1 day ago

    Chennai, Tamil Nadu, India CX Data Labs Full time

    HiRole - Azure Data engineerLocation - Chennai, GurugramWork from officeFull timeImmediate joiner Only (15days Notice period only)Candidates with Certification in Databricks is good to haveTechnical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o...

  • Databrick

    1 day ago

    Chennai, Tamil Nadu, India Virtusa Full time

    We are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Databricks PySpark and cloud platforms such as Azure or AWS and a strong background in data pipeline development performance optimization and data governance.Key...

  • Senior Data Engineer- Azure Databricks

    1 day ago

    Chennai, Tamil Nadu, India InfoCepts Full time

    Position: Data Engineer- Azure DatabricksPurpose of the Position:To design, build, and optimize scalable data pipelines and solutions using Azure Databricks and related technologies, enabling Zodiac Maritime to make faster, data-driven decisions as part of its data transformation journey.Proficiency in data integration techniques, ETL processes and data...

  • Databricks Architect

    3 days ago

    Chennai, Tamil Nadu, India Decision Minds Full time

    Role DescriptionThis is a full-time hybrid role ( Multiple roles) for a Databricks lead and Architect located in Chennai and Pondicherry, with the flexibility to work remotely on occasion. The Databricks Architect will be responsible for designing scalable architectures, developing software solutions, integrating Databricks with other platforms, and creating...

  • Databricks AI Engineer

    1 day ago

    Chennai, Tamil Nadu, India Enoah Isolution Full time

    Role & responsibilitiesProgramming & Query Languages: Proficient in Python and SQL for data analysis, modeling, and database management.Machine Learning & AI Models: Experience with regression, decision trees, SVM, deep learning (CNNs, RNNs, Transformers), and advanced AI (GNNs, RL, GANs, LLMs such as GPT-4, Claude, LLaMA).Natural Language & Vision AI:...

  • Databrick AWS

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time

    EssentialBachelors degree or equivalent in Computer Engineering Computer Science or a related field5 years of experience in data software engineering role3 years of strong hands on experience with Databricks with AWS as a cloud platform which including Spark based processing data pipelines and the platforms tools for analytics and machine learning2 years of...

  • Databrick AWS

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Bachelors degree or equivalent in Computer Engineering Computer Science or a related field5 years of experience in data software engineering role3 years of strong hands on experience with Databricks with AWS as a cloud platform which including Spark based processing data pipelines and the platforms tools for analytics and machine learning2 years of...

  • Databricks

    1 day ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time

    Job descriptionAzure Databricks + PysparkLocation - CoimbatoreExpereince - 6 to 8 YearsExperience with Azure Data Bricks, Data FactoryExperience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE AnalyticsExperience in Python/Pyspark/Scala/Hive Programming.Experience with Azure Databricks/ADBExperience with building CI/CD...