Data Engineer

2 weeks ago

Chennai, Tamil Nadu, India CG-VAK Software & Exports Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Title:
Data Engineer (Scala, Spark, Pyspark, Databricks)
Remark - final round will be the F2F

Experience: 10+ Years (Lead Role)
Responsibilities

  • Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.
  • Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency.
  • Optimize Spark applications for performance and cost-efficiency within the Databricks environment.
  • Work with Delta Lake for building reliable data lakes and data warehouses, ensuring ACID transactions and data versioning.
  • Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and deliver solutions.
  • Implement data governance and security best practices within Databricks.
  • Troubleshoot and resolve data-related issues, ensuring data availability and reliability.
  • Stay updated with the latest advancements in Spark, Scala, Databricks, and related big data technologies.

Required Skills And Experience

  • Proven experience as a Data Engineer with a strong focus on big data technologies.
  • Expertise in Scala programming language for data processing and Spark application development.
  • In-depth knowledge and hands-on experience with Apache Spark, including Spark SQL, Spark Streaming, and Spark Core.
  • Proficiency in using Databricks platform features, including notebooks, jobs, workflows, and Unity Catalog.
  • Experience with Delta Lake and its capabilities for building data lakes.
  • Strong understanding of data warehousing concepts, data modeling, and relational databases.
  • Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
  • Experience with version control systems like Git.
  • Excellent problem-solving and analytical skills.
  • Ability to work independently and as part of a team.

Preferred Qualifications (Optional)

  • Experience with other big data technologies like Kafka, Flink, or Hadoop ecosystem components.
  • Knowledge of data visualization tools.
  • Understanding of DevOps principles and CI/CD pipelines for data engineering.
  • Relevant certifications in Spark or Databrick

Skills: data,big data technologies,scala,spark,apache spark,big data

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time

    Senior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - 8+ years Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.

  • Data Centre Remote Technical Support Engineer

    6 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Centre...

  • Data & Business Insights Associate

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Works under supervision with internal and external teams to understand customer requirementsAbility to elaborate on the details of a project Collaborate with Automation Engineers, Machine Learning Engineers, Data Analysts and Business Intelligence Analyst to execute deliverables.Must possess technical writing, decision making, and problem-solving skills.Must...

  • Data Activity Monitoring

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA, Inc. Full time ₹ 60,000 - ₹ 1,20,000 per year

    Role: Data Activity Monitoring (DAM) Engineers – L1 & L2Location:Chennai, IndiaEducation:BE / B.Tech / MCAinElectronics, Electrical, or Computer SciencePosition 1: DAM Engineer – L1Experience:2 yearsBudget:₹5.85 LPAKey Responsibilities:Support day-to-day operations of Data Activity Monitoring tools .Monitor database and application activity to...

  • Senior Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Security...

  • Testing Engineering Specialist

    6 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Req ID: 349941NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Testing Engineering Specialist to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). API Testing, Java,...

  • Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Req ID: 346251NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). Who We Are: NTT DATA America strives to hire...

  • Senior Data Consultant

    3 days ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    We are looking for a high-energy individual for the role of Senior Data Consultant at Eucloid. The candidate will collaborate with client stakeholders on multiple projects in the eCommerce team.The candidate is expected to lead following work-streams:• Drive client meetings with data-driven insights and observations on key website/app metricsfor Upper...

  • Data & Business Insights Associate

    4 days ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time

    Data & Business Insights AssociateSummaryNTTDATA Services are seeking Data & Business Insights Associate with basic understanding of data and reporting. They will also work with data analysts and automation experts to create new visuals and features that support business intelligence initiatives.AccountabilitiesUnderstand, Gathering and Prepare the...

  • Network Security Services Engineer

    4 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Cross...