Data Engineer

3 weeks ago


noida, India Transaction Network Services Full time

An extraordinarily talented group of individuals work together every day to drive TNS' success, from both professional and personal perspectives.Come join the excellence

Overview

Transaction Network Services (TNS), a Koch Industries company is seeking a talented and motivated data engineer to work within our AI Labs, India. As a Data Engineer you will initially focus on collecting and analyzing data from our international sources as well as supporting the senior staff of data scientists. You will be designing scalable data architectures to efficiently perform data processing, storage, and analysis. As responsibility increases over time, your role is expected to expand to include managing international data requirements and use within TNS.

Responsibilities

Primary Responsibilities:

Determine operational data objectives by studying international business functions; gathering information; evaluating output requirements and formats. Design, develop, and maintain robust and scalable data pipelines to efficiently collect, process, and store large volumes of data. Collaborate with data scientists and analysts to understand data requirements and implement solutions for data transformation, integration, and analysis. Implement and manage data lakes, data warehouses, and other data storage solutions on the AWS environment. Collaborate with DevOps and infrastructure teams to automate data pipeline deployments and ensure smooth operations. Implement MLOps practices for model deployment, monitoring, and version control. Ensure data security, privacy, and compliance with relevant regulations and best practices. Single point of contact for both business and technology teams on data requirements. Perform both business and technical QA of any software developed. Prepare technical reports by collecting, analyzing, and summarizing information and trends. Contribute to the greater team effort by accomplishing related results as needed.

Qualifications

Qualifications

Education/Experience:

Advanced degree in computer science, machine learning, statistical methods, or related field. 5 years of industry experience in data engineering or a related role. Strong experience building and maintaining data pipelines using AWS services such as S3, Redshift, Glue, EMR, or related technologies. Proficiency in programming languages such as Python, Java, or Scala. Experience with data modeling, database design, and SQL. Familiarity with DevOps practices and tools, including CI/CD pipelines and infrastructure-as-code (e.g., Terraform). Demonstrated ability to work with large data sources with a focus on data privacy and security. Background in software development process and tools with a focus on Jira. Experienced in working in a geographically distributed team environment. Experience working for leadership located in other countries and cultures as well as large time zone shifts.

Communications:

Excellent communication & presentation skills. Strong teamwork, communication skills, passion, creativity, productivity & learning agility. Strong written and verbal communications skills working with internationally based colleagues. Ability to articulate and interpret analytical results from developed programs.

Related Knowledge base:

Familiarity with big data processing frameworks such as Apache Spark or Hadoop. Knowledge of stream processing frameworks like Apache Kafka or AWS Kinesis. Experience with containerization technologies like Docker and orchestration tools like Kubernetes. Understanding of data governance, data cataloging, and metadata management.

If you are passionate about technology, love personal growth and opportunity, come see what TNS is all about

TNS is an equal opportunity employer. TNS evaluates qualified applicants without regard to race, color, religion, gender, national origin, age, sexual orientation, gender identity or expression, protected veteran status, disability/handicap status or any other legally protected characteristic.


  • Data Engineer

    2 weeks ago


    Noida, India Infogain Full time

    Experience : 6 to 9 yearsRequirement : Immediate Joiner or one month notice period only.Location : BangaloreWork Mode : HybridTitle:Big Data Engineer (Senior): As a Big Data Engineer (Senior), you will be responsible for designing and implementing complex big data solutions. You will work closely with clients and team members to understand their requirements...

  • Data Engineer

    2 weeks ago


    noida, India Infogain Full time

    Experience : 6 to 9 years Requirement : Immediate Joiner or one month notice period only. Location : Bangalore Work Mode : Hybrid Title: Big Data Engineer (Senior): As a Big Data Engineer (Senior), you will be responsible for designing and implementing complex big data solutions. You will work closely with clients and team members to understand their...

  • Data Engineer

    2 weeks ago


    Noida, India Infogain Full time

    Experience : 6 to 9 yearsRequirement : Immediate Joiner or one month notice period only.Location : BangaloreWork Mode : HybridTitle:Big Data Engineer (Senior): As a Big Data Engineer (Senior), you will be responsible for designing and implementing complex big data solutions. You will work closely with clients and team members to understand their requirements...


  • noida, India Docyt Full time

    Docyt, a leading FinTech startup headquartered in Silicon Valley, is looking for a talented and versatile Data Engineer/Data Analyst to join our dynamic team. As a Data Engineer/Data Analyst at Docyt, you will play a crucial role in managing and analyzing the company's vast amounts of financial data. You will be responsible for developing and implementing...


  • Noida, India Docyt Full time

    Docyt, a leading FinTech startup headquartered in Silicon Valley, is looking for a talented and versatile Data Engineer/Data Analyst to join our dynamic team. As a Data Engineer/Data Analyst at Docyt, you will play a crucial role in managing and analyzing the company's vast amounts of financial data. You will be responsible for developing and implementing...

  • Data Engineer

    3 weeks ago


    Noida, India Transaction Network Services Full time

    An extraordinarily talented group of individuals work together every day to drive TNS' success, from both professional and personal perspectives.Come join the excellence! Overview Transaction Network Services (TNS), a Koch Industries company is seeking a talented and motivated data engineer to work within our AI Labs, India. As a Data Engineer you will...

  • Data Engineer

    2 days ago


    noida, India SP Software Solutions Full time

    Azure Date EngineerMultiple Locations in India(Bengaluru, Chennai, Hyderabad, Kochi, Kolkata, Lucknow, Mumbai, Noida, Pune)Strong experience in SQL, Azure, Azure Data Factory, Databricks, Python, Spark, PySparkModerate experience in CI/CDRequirements:- Strong proficiency in Microsoft Azure cloud platform services (Azure Cloud, Databricks(pyspark), ADF, ADLS,...

  • Data Engineer

    1 week ago


    Noida, India Aces Global Consulting Pvt Ltd Full time

    Job Description of Data Engineer Location : Noida / Gurgaon Salary : 10-12 LPA Years of experience : 4-5 Years - Data Engineer with 4-5 strong year of data experience with 2-3 years of IICS experience - Hands on experience of Python, great SQL skills - Experience of working in operations - Knowledge of CI/CD, monitoring is desired skill - Great English...

  • Data Engineer

    2 days ago


    Noida, India FCM Travel India Full time

    Purpose:The ETS Data Engineer Leader is accountable for the identification of trends and automation or customer improvement opportunities using ETS system information including ServiceNow.The Data Engineer’s role is to design data modeling/analysis services used to mine enterprise systems and applications for knowledge and information that enhance business...

  • Data Engineer

    17 hours ago


    Noida, India FCM Travel India Full time

    Purpose:The ETS Data Engineer Leader is accountable for the identification of trends and automation or customer improvement opportunities using ETS system information including ServiceNow.The Data Engineer’s role is to design data modeling/analysis services used to mine enterprise systems and applications for knowledge and information that enhance business...

  • Data Engineer

    4 weeks ago


    Noida, India WSP in India Full time

    Description We seek a technical backend data engineer to help us develop solutions in our Azure Synapse Analytics platform. The responsibility is to work with ingesting data (On-Prem SQL, Rest API to cloud solutions, etc), the transformation to the silver layer (PySpark, SQL), and setting up datasets with star schema data model optimized for Power BI...

  • Data Engineer

    4 weeks ago


    Noida, India WSP in India Full time

    DescriptionWe seek a technical backend data engineer to help us develop solutions in our Azure Synapse Analytics platform.The responsibility is to work with ingesting data (On-Prem SQL, Rest API to cloud solutions, etc), the transformation to the silver layer (PySpark, SQL), and setting up datasets with star schema data model optimized for Power BI reports....

  • Data Engineer

    4 weeks ago


    Noida, India WSP in India Full time

    DescriptionWe seek a technical backend data engineer to help us develop solutions in our Azure Synapse Analytics platform.The responsibility is to work with ingesting data (On-Prem SQL, Rest API to cloud solutions, etc), the transformation to the silver layer (PySpark, SQL), and setting up datasets with star schema data model optimized for Power BI reports....

  • Data Engineer

    4 weeks ago


    noida, India Antal International Full time

    Job Description Work Exp: 3-6 Yrs. of experience Assist in creating Big Data platform which will give us power to process massive data. As well as, work closely with Data Scientists to enable machine learning and advance analytics capabilities. Data Lake hosted on cloud, integrates range of internal and external data sources. Focus on the...

  • Data Engineering Lead

    2 weeks ago


    Noida, India GIST Impact Full time

    Role Description : As a Data Engineering Lead, you will play a crucial role in overseeing the design, development, and maintenance of our organization's data architecture and infrastructure. You will be responsible for designing and developing the architecture for the data platform that ensures the efficient and effective processing of large volumes of...

  • Associate Principal

    4 weeks ago


    Noida, India LTIMindtree Full time

    Associate Principal - Data Engineering Job Req Id: 1272734 "Primary Skills: Azure Databricks, Azure SQL, Power BI Expertise to Implementing Data warehousing Solutions experience as Data Engineer in Azure Big Data Environment Programming experience in Scala or Python, SQL Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory, Azure...

  • Associate Principal

    4 weeks ago


    noida, India LTIMindtree Full time

    Associate Principal - Data Engineering Job Req Id: 1272734 "Primary Skills: Azure Databricks, Azure SQL, Power BI Expertise to Implementing Data warehousing Solutions experience as Data Engineer in Azure Big Data Environment Programming experience in Scala or Python, SQL Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory, Azure...

  • Senior Manager

    4 weeks ago


    Noida, India Clarivate Full time

    We are looking for a Senior Manager in Software Engineering to join our dynamic software engineering team in Noida. This is a unique opportunity to lead and innovate within the Intellectual Property segment, focusing on data engineering and systems integration.This position will report to the Director of IP Technology. The role demands a hands-on approach,...

  • Senior Manager

    4 weeks ago


    Noida, India Clarivate Full time

    We are looking for a Senior Manager in Software Engineering to join our dynamic software engineering team in Noida. This is a unique opportunity to lead and innovate within the Intellectual Property segment, focusing on data engineering and systems integration. This position will report to the Director of IP Technology. The role demands a hands-on approach,...

  • Senior Manager

    4 weeks ago


    Noida, India Clarivate Full time

    We are looking for a Senior Manager in Software Engineering to join our dynamic software engineering team in Noida. This is a unique opportunity to lead and innovate within the Intellectual Property segment, focusing on data engineering and systems integration.This position will report to the Director of IP Technology. The role demands a hands-on approach,...