Senior Data Engineer

3 weeks ago


Hyderabad, Telangana, India Tata Consultancy Services Full time
Job Title: Senior Data Engineer - Python Pyspark

Location: Kolkata, Mumbai, Hyderabad

Experience: 6-10 Years

Job Description:

We are seeking a highly skilled Senior Data Engineer with expertise in Python Pyspark to join our team at Tata Consultancy Services. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Spark and Python.

Key Responsibilities:

  1. Design and develop scalable data processing systems using Spark and Python.
  2. Develop and maintain complex data pipelines using Pyspark.
  3. Collaborate with cross-functional teams to integrate data processing systems with other applications.
  4. Optimize data processing systems for performance and scalability.
  5. Develop and maintain unit tests and integration tests for data processing systems.

Requirements:

  • Proficient in Python Pyspark, including RDDs, DataFrames, and Spark SQL.
  • Experience in data processing and manipulation using Spark transformations and actions.
  • Knowledge of Spark architecture and optimization techniques for performance tuning.
  • Competence in programming languages such as Scala, Python, or Java for Spark development.
  • Experience in working with big data technologies and distributed computing environments.
  • Strong problem-solving skills and the ability to troubleshoot issues in Spark applications.
  • Proficiency in version control systems like Git for collaborative development.

  • Senior Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India The Modern Data Company Full time

    Job Title: Senior Analytics EngineerAt The Modern Data Company, we are seeking a highly skilled Senior Analytics Engineer to join our team. The ideal candidate will have a strong background in data engineering, architecture, and analytics, with a passion for designing and implementing scalable data solutions.Key Responsibilities:Provide technical expertise...

  • Senior Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India NTT DATA Business Solutions Full time

    A Senior Data Engineer plays a pivotal role in technology-driven organizations, responsible for designing, building, and managing the infrastructure and tools that enable efficient processing and analysis of large data sets.Responsibilities:Designing and Implementing ETL Processes:Develop and maintain scalable data pipelines.Create efficient Extract,...

  • Senior Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India The Modern Data Company Full time

    Job Description :The Senior Data Engineer will provide technical expertise in needs identification, data modeling, data movement, and transformation mapping (source to target), automation and testing strategies, translating business needs into technical solutions with adherence to established data guidelines and approaches from a business unit or project...

  • Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India data Full time

    Job DescriptionAbout the RoleWe are seeking a highly skilled Data Analyst to join our team at data.ai. As a Data Analyst, you will be responsible for analyzing, monitoring, and delivering comprehensive and high-quality app market data to app professionals.Key ResponsibilitiesTake full responsibility for data.ai core intelligence data qualityDeep...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Digital Engineering Senior Software EngineerAbout the Role:We are seeking an experienced Digital Engineering Senior Software Engineer to join our team. As a key member of our digital transformation team, you will be responsible for leading the design, development, and implementation of cutting-edge digital solutions.Key Responsibilities:Lead the...

  • Big Data Engineer

    7 days ago


    Hyderabad, Telangana, India data Full time

    Overview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai India subsidiary entity. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Senior Data Migration ConsultantWe are seeking an experienced Senior Data Migration Consultant to join our team at NTT DATA Services. As a Senior Data Migration Consultant, you will be responsible for performing data migration of SAP Asset Master Data objects from SAP ECC to SAP S4/HANA.Key Responsibilities:12 years of experience in SAP Data...


  • Hyderabad, Telangana, India data Full time

    Unlock the Power of Data with UsWe're seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative analytics and data products. As a key member of our engineering team, you will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to design and implement complex data product...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Senior Syniti ADM ConsultantAbout the RoleWe are seeking an experienced Senior Syniti ADM Consultant to join our team. As a key member of our data migration team, you will be responsible for performing data migration of SAP Asset Master Data objects from SAP ECC to SAP S4/HANA.Key Responsibilities12 years of experience in SAP Data Cleansing,...


  • Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using Python (e.g.,...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team in Hyderabad, India. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using...

  • Senior Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India ValueLabs Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at ValueLabs. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines, data warehouses, and data lakes for our organization.Key Responsibilities:Data Pipeline Development: Design and develop data pipelines using ADF,...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job DescriptionReq ID: 295140 NTT DATA is seeking a talented individual to fill the role of Digital Engineering Senior Engineer. We strive to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, we encourage you to apply.We are currently seeking...

  • Senior Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Experian Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Experian. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines and ETL processes in the AWS environment.Key Responsibilities:Design and develop scalable ETL processes to deliver meaningful...

  • Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India NTT DATA Services Full time

    Job Title: Data EngineerNTT DATA Services is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and testing scalable Big Data ecosystems for our clients.Key Responsibilities:Analyze and understand data sources and APIsDesign and develop methods to connect and collect data from...

  • Senior Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Experian Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our agile team at Experian. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems that meet the needs of our customers.Key Responsibilities:Design and develop data pipelines to extract, transform, and...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job DescriptionJob Title: Senior Data Migration DeveloperJob Summary: We are seeking a highly skilled Senior Data Migration Developer to join our team. The ideal candidate will have extensive experience in developing data migration tools, configuring LTMOM, and creating LSMW. They will also have hands-on experience with LTMOM, including creating custom...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data Migration Senior DeveloperAbout the Role:We are seeking a highly skilled Data Migration Senior Developer to join our team at NTT DATA Services. As a key member of our team, you will be responsible for developing and implementing data migration solutions using SAP technologies.Key Responsibilities:Develop and configure data migration tools...

  • Senior Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Experian Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our agile team at Experian. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems that meet the needs of our customers.Key Responsibilities:Design and develop data pipelines using Spark and...