Data Engineer

4 days ago

Chennai, Tamil Nadu, India CG-VAK Software & Exports Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Title:
Data Engineer (Scala, Spark, Pyspark, Databricks)
Remark - final round will be the F2F

Experience: 10+ Years (Lead Role)
Responsibilities

  • Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.
  • Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency.
  • Optimize Spark applications for performance and cost-efficiency within the Databricks environment.
  • Work with Delta Lake for building reliable data lakes and data warehouses, ensuring ACID transactions and data versioning.
  • Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and deliver solutions.
  • Implement data governance and security best practices within Databricks.
  • Troubleshoot and resolve data-related issues, ensuring data availability and reliability.
  • Stay updated with the latest advancements in Spark, Scala, Databricks, and related big data technologies.

Required Skills And Experience

  • Proven experience as a Data Engineer with a strong focus on big data technologies.
  • Expertise in Scala programming language for data processing and Spark application development.
  • In-depth knowledge and hands-on experience with Apache Spark, including Spark SQL, Spark Streaming, and Spark Core.
  • Proficiency in using Databricks platform features, including notebooks, jobs, workflows, and Unity Catalog.
  • Experience with Delta Lake and its capabilities for building data lakes.
  • Strong understanding of data warehousing concepts, data modeling, and relational databases.
  • Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
  • Experience with version control systems like Git.
  • Excellent problem-solving and analytical skills.
  • Ability to work independently and as part of a team.

Preferred Qualifications (Optional)

  • Experience with other big data technologies like Kafka, Flink, or Hadoop ecosystem components.
  • Knowledge of data visualization tools.
  • Understanding of DevOps principles and CI/CD pipelines for data engineering.
  • Relevant certifications in Spark or Databrick

Skills: data,big data technologies,scala,spark,apache spark,big data

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Data Engineer – Chennai Build the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights. Location: Chennai, India Experience: 2–3 years in data engineering or data-driven product development Role Overview As a Data Engineer, you will be responsible for building and...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...

  • Lead Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support the development of data infrastructure for our clients by participating in activities that may include starting from upstream and downstream technology selection to designing and building different components....

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are seeking a Senior Data Engineer with10+ yearsof experience to join our team.Required Qualifications10+ years of experience in data engineering or similar role.Hands on experience in snowflake, SSIS, Python ( including NumPy and Pandas) is mandatory.Expertise in SQL and any cloud environment (AWS & Azure, etc.) is mandatory.Proficiency in mordern BI...

  • Senior Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks and pipelines using Python, Elasticsearch, SQL DB, and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable and...

  • Senior Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time

    Senior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - 8+ years Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.

  • Lead Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solutions Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    About the RoleWe are seeking a Lead Data Engineer to join our team. In this role, you will be crucial in designing, building, and maintaining our data infrastructure. This is a hands-on position requiring a strong foundation in data warehousing, ETL processes, and database management. The ideal candidate will have a keen eye for detail and the ability to...

  • Data & Business Insights Associate

    2 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Works under supervision with internal and external teams to understand customer requirementsAbility to elaborate on the details of a project Collaborate with Automation Engineers, Machine Learning Engineers, Data Analysts and Business Intelligence Analyst to execute deliverables.Must possess technical writing, decision making, and problem-solving skills.Must...

  • Data Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Unifi Data Management Services Full time ₹ 20,00,000 - ₹ 50,00,000 per year

    Role Summary:The Data Architect is responsible for designing, governing, and implementing enterprise-wide data architecture strategies to enable trusted, scalable, and high-performing data platforms. This role ensures data consistency, security, and accessibility across multiple business domains aligning data initiatives with business goals and digital...

  • Data Activity Monitoring

    4 days ago

    Chennai, Tamil Nadu, India NTT DATA, Inc. Full time ₹ 60,000 - ₹ 1,20,000 per year

    Role: Data Activity Monitoring (DAM) Engineers – L1 & L2Location:Chennai, IndiaEducation:BE / B.Tech / MCAinElectronics, Electrical, or Computer SciencePosition 1: DAM Engineer – L1Experience:2 yearsBudget:₹5.85 LPAKey Responsibilities:Support day-to-day operations of Data Activity Monitoring tools .Monitor database and application activity to...