Data Engineering

6 days ago

tamil nadu, India EXL Full time

Responsibilities:Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create the data integration and data diagram documentation.Lead the data validation, UAT and regression test for new data asset creation.Create and maintain data models, including schema design and optimization.Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.Qualifications and Skills:Strong knowledge on Python and PysparkExpectation is to have ability to write Pyspark scripts for developing data workflows.Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and GreenplumExpectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum.Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks.Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows.Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing.Expectation is to have strong problem-solving and troubleshooting skills.Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes.Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience.3-7 years of experience in Data Engineer.Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL.Experience in GCP computing platform, such as developing ETL processes Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.

  • Senior Data Engineer

    1 day ago

    tamil nadu, India Eucloid Data Solutions Full time

    Job Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Data Scientist

    2 weeks ago

    tamil nadu, India Capgemini Engineering Full time

    Data Scientist Location : Chennai / Coimbatore Experience : 4–9 years Choosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading healthcare and consumer electronics organizations unlock the value of sensor...

  • Data Scientist

    2 weeks ago

    tamil nadu, India Capgemini Engineering Full time

    Data Scientist Location: Chennai / CoimbatoreExperience: 4–9 yearsChoosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading healthcare and consumer electronics organizations unlock the value of sensor data...

  • Data & Business Insights Associate

    7 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    **Data & Business Insights Associate**Summary**NTTDATA Services are seeking Data & Business Insights Associate with basic understanding of data and reporting. They will also work with data analysts and automation experts to create new visuals and features that support business intelligence initiatives.**Accountabilities**Understand, Gathering and Prepare the...

  • Data & Business Insights Associate

    13 hours ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    **Data & Business Insights Associate** **Summary** NTTDATA Services are seeking Data & Business Insights Associate with basic understanding of data and reporting. They will also work with data analysts and automation experts to create new visuals and features that support business intelligence initiatives. **Accountabilities** - Understand, Gathering and...

  • Senior Data Consultant

    4 weeks ago

    tamil nadu, India Eucloid Data Solutions Full time

    We are looking for a high-energy individual for the role of Senior Data Consultant at Eucloid. The candidate will collaborate with client stakeholders on multiple projects in the eCommerce team. The candidate is expected to lead following work-streams: • Drive client meetings with data-driven insights and observations on key website/app metricsfor Upper...

  • Senior Data Consultant

    6 days ago

    tamil nadu, India Eucloid Data Solutions Full time

    We are looking for a high-energy individual for the role of Senior Data Consultant at Eucloid. The candidate will collaborate with client stakeholders on multiple projects in the eCommerce team.The candidate is expected to lead following work-streams:• Drive client meetings with data-driven insights and observations on key website/app metricsfor Upper...

  • Data Engineer

    3 days ago

    tamil nadu, India LTIMindtree Full time

    Data Engineer:Experience required: 8 to 12 yearsJob location: Chennai, Hyderabad, Pune (5 days work from office from client location)Seeking a highly skilled and motivated Engineering Lead to join our team as a Cloud and Data Engineer. The ideal candidate will possess extensive expertise in cloud technologies and data engineering, with a proven ability to...

  • Data Engineer

    1 week ago

    tamil nadu, India Tata Consultancy Services Full time

    Big Data/Hadoop Experience particularly in ingesting data and implementing Data ingestion pipelines, SQOOP, HADOOP, HDFS, HIVE, IMPALA, Java, Scala, Spark Scala is Mandatory Data Engineer with below responsibilities:Lead Data Engineer to build data pipelines to support implementation of data science and analytics use cases. Candidate needs to be able to...

  • Data Engineer

    2 days ago

    tamil nadu, India Tata Consultancy Services Full time

    Big Data/Hadoop Experience particularly in ingesting data and implementing Data ingestion pipelines, SQOOP, HADOOP, HDFS, HIVE, IMPALA, Java, Scala, Spark Scala is Mandatory Data Engineer with below responsibilities: Lead Data Engineer to build data pipelines to support implementation of data science and analytics use cases. Candidate needs to be able to...