Data Engineering

1 day ago

tamil nadu, India EXL Full time

Responsibilities:

  • Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.
  • Create the data integration and data diagram documentation.
  • Lead the data validation, UAT and regression test for new data asset creation.
  • Create and maintain data models, including schema design and optimization.
  • Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.

Qualifications and Skills:

  • Strong knowledge on Python and Pyspark
  • Expectation is to have ability to write Pyspark scripts for developing data workflows.
  • Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum
  • Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum.
  • Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks.
  • Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows.
  • Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing.
  • Expectation is to have strong problem-solving and troubleshooting skills.
  • Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes.
  • Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience.
  • 3-7 years of experience in Data Engineer.
  • Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL.
  • Experience in Azure cloud computing platform, such as developing ETL processes using Azure Data Factory, big data processing and analytics with Azure Databricks.
  • Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.

  • Data Architect

    1 week ago

    tamil nadu, India Capgemini Engineering Full time

    Data Architect / Data EngineerLocation: ChennaiExperience: 4–6 yearsYour RoleAs a Data Architect / Data Engineer, you will be responsible for creating and maintaining digital twin models and integrating real-time data streams to support simulation and analytics in maritime systems. You will work with advanced tools and platforms to build scalable,...

  • Senior Data Engineer

    5 days ago

    tamil nadu, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Data Scientist

    3 days ago

    tamil nadu, India Capgemini Engineering Full time

    Data Scientist / AnalystLocation: Chennai, IndiaExperience: 12+ yearsChoosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping transform maritime operations through intelligent digital twin platforms that drive...

  • Data Scientist

    5 days ago

    tamil nadu, India Capgemini Engineering Full time

    Data Scientist / Analyst – Digital Twin of ShipsLocation: Chennai, IndiaWork Mode: Hybrid (3 days/week from office)Experience Required: 12–17 yearsQualifications: Bachelor’s or Master’s degree in engineeringChoosing this opportunity means joining a team at the forefront of maritime innovation, where data science meets sustainability. You’ll be...

  • Data & Business Insights Associate

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Data Business Insights Associate Summary NTTDATA Services are seeking Data Business Insights Associate with basic understanding of data and reporting They will also work with data analysts and automation experts to create new visuals and features that support business intelligence initiatives Accountabilities Understand Gathering and Prepare the...

  • Data Engineer

    1 week ago

    tamil nadu, India Impetus Career Consultants Full time

    HIRING FOR A USA BASED MNC -Location - Chennai Experience : 3-10years Data Engineer T3Bachelor’s or master’s degree with 3+ years of experience in Computer Science, Data Science, Engineering, or a related field.3+ years of experience in working with Python, SQL, PySpark and bash scripts. Proficient in software development lifecycle and software...

  • Data Engineer

    1 week ago

    tamil nadu, India LTIMindtree Full time

    We are hiring for AWS Data EngineerExperience - 5 to 7 YearsLocation : Chennai Notice period - immediate to 30 daysJob SummarySeeking a Specialist with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills to design and implement scalable IoT data solutions4 years of experience in GCP BQ Dataflow Airflow and Python Should have hands...

  • Data Engineer

    1 week ago

    tamil nadu, India Impetus Full time

    Skills: Bigdata, Pyspark, Python ,Hadoop / HDFS; Spark; Good to have : GCP/any cloud Roles/Responsibilities:Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity.Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and...

  • Data Engineer

    5 days ago

    tamil nadu, India Talent Corner HR Services Pvt Ltd Full time

    JOB OBJECTIVEWe are seeking a dynamic professional to fill in our Data Engineering role who will be responsible for designing, developing, and maintaining the data architecture, infrastructure, and pipelines that enable to collect, store, process, and analyze large volumes of data. This role will play a crucial part in ensuring data availability, quality,...

  • Data Engineer

    1 day ago

    tamil nadu, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,Job SummaryThe Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements...