Data Engineer

4 weeks ago

Chennai, Tamil Nadu, India SGS Technical Services Pvt. Ltd Full time

Job Title : Data : Chennai, India


Immediate Joiners Preferred: Notice period of up to 15 Keywords : Python Py spark ,SQL, with azure, data pipeline, Data warehouse (like snowflake) ETL control


Job Description :

We are seeking a highly skilled Data Engineer to join our team in Chennai. The ideal candidate should have strong expertise in Python, PySpark, SQL, Azure services, data pipelines, and data warehouse technologies like Snowflake. If you're passionate about building robust ETL processes and ensuring data quality and reliability, we want to hear from you.

Responsibilities :

  • Design, develop, and maintain scalable data pipelines using Python and PySpark.
  • Collaborate with cross-functional teams to understand data requirements and design appropriate solutions.
  • Implement ETL processes to extract, transform, and load data from various sources into our data warehouse (e.g., Snowflake).
  • Optimize data pipelines for performance, reliability, and scalability.
  • Ensure data quality and integrity throughout the ETL process.
  • Monitor and troubleshoot production data pipelines to ensure smooth operation.
  • Work closely with stakeholders to understand business needs and translate them into technical requirements.
  • Provide technical guidance and support to junior team members.

Requirements :

  • Bachelor's degree in computer science, Engineering, or a related field.
  • Proven experience as a Data Engineer or similar role.
  • Strong programming skills in Python and proficiency in SQL.
  • Hands-on experience with PySpark for big data processing.
  • Familiarity with cloud platforms, particularly Azure.
  • Experience building and maintaining data pipelines.
  • Knowledge of data warehouse concepts and experience working with platforms like Snowflake.
  • Strong understanding of ETL principles and best practices.
  • Excellent problem-solving and communication skills.
  • Ability to work independently and as part of a team in a fast-paced environment.
  • Expert knowledge in any of the following ETL processes ETL control tables, Error logging, Auditing.
  • Solid working experience on writing ETL jobs using standard components.
  • Ability to spin new ETL jobs or modify the existing job based on requirements.
  • Ability to support & troubleshoot any existing ETL jobs for failures and suggest fix to avoid failures.
  • Build and maintain complex ETL and data pipelines to load and maintain data.
Preferred Qualifications :
  • Experience with other big data technologies such as Apache Spark, Hadoop, or Kafka.
  • Familiarity with containerization technologies like Docker and orchestration tools like Kubernetes.
  • Knowledge of data governance and compliance standards.
  • If you meet the above qualifications and are ready to take on this exciting challenge, we encourage you to apply and become part of our dynamic team

(ref:hirist.tech)

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionWe are looking for a skilled Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). If you are ready to tackle challenging tasks and work with a team of experts, this might be the perfect opportunity for you. Check out the details below:Create and maintain test deliverables and artifacts for complex applications and system...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionData Engineer - Snowflake, Oracle/MySQL, NoSQL, Python8 to 13 years of experience in Data engineeringExtensive experience in different database platforms both RDBMS and NoSQLHands-on experience in SnowflakeProficient in Data Pipeline OrchestrationProficient in a programming language (Python or Go)Exposure to Data warehousing and...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN). Azure Data Engineer,...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN).Azure Data Engineer, you...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Req ID:282638NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe are looking...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Req ID:269806NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN).Azure Data Engineer, you will be...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN). Azure Data Engineer, you will be...

  • Digital Engineering Staff Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Staff Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)....

  • Digital Engineering Staff Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Staff Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Who we...

  • Digital Engineering Staff Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionReq ID:273782NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Staff Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India...

  • Autocad Draughtsman/woman

    1 week ago

    Chennai, Tamil Nadu, India Planners and Engineer Full time

    Requirement for Auto cad those have knownledge in Pre DCR ONLINE DRAWINGWORKING DRAWING & CMDA APPROVAL DRAWING & LAYOUT BASED COMBINED DRAWING. Should have excellent communication skills Ability to work independently with little supervision as well as the ability to work within a team. Excellent multitasking skills Selfmotivated with strong team spirit...

  • Digital Engineering Staff Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Req ID:277685NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Staff Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Who we are:NTT...

  • Specialist - Data Center Operations

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionThe role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks,...

  • Digital Engineering Staff Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Staff Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). Who we are: NTT...

  • Data Engineer

    1 month ago

    Chennai, Tamil Nadu, India Ford Motor Company Full time

    This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. Data engineers will work in small, cross-functional teams. They...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Ford Motor Company Full time

    This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. Data engineers will work in small, cross-functional teams. They...

  • Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Ford Motor Company Full time

    This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. Data engineers will work in small, cross-functional teams. They...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Encora Inc. Full time

    hereLead Data EngineerJD :Qualifications5 to 10 years of hands-on Big Data Engineering experienceExcellent communication and collaboration skillsDemonstrated strong leadership skills in leading a teamKey responsibilities include:Create and maintain data pipelines to transform and load data from data lake into Datawarehouse modelsImplement automated Data...