Big Data Python Engineer

5 months ago


Hyderabad, India Virtusa Full time
Big Data Python Engineer - CREQ191701 Description Role GDT WS Big Data Python Engineer
Exp 5+
Location Pune/Hyderabad

MUST Have Skills
Design and implement data processing pipelines using Python + SCALA programming and big data technologies such as Hadoop, MapReduce, Hive, and Spark.
Airflow
Jenkins
Understand business requirements to code up data assets in pyspark. Design, develop, test, and maintain data assets.
Troubleshoot, debug, and optimise data pipelines for maximum performance and scalability.
Collaborate with data and business analysts to implement data solutions that meet business requirements.

Nice to have skills
API experience Java
Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary Skills PySpark Years of Experience 5 Qualification

Role GDT WS Big Data Python Engineer
Exp 5+
Location Pune/Hyderabad

MUST Have Skills
Design and implement data processing pipelines using Python + SCALA programming and big data technologies such as Hadoop, MapReduce, Hive, and Spark.
Airflow
Jenkins
Understand business requirements to code up data assets in pyspark. Design, develop, test, and maintain data assets.
Troubleshoot, debug, and optimise data pipelines for maximum performance and scalability.
Collaborate with data and business analysts to implement data solutions that meet business requirements.

Nice to have skills
API experience Java

Travel No
  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India data Full time

    Overview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...


  • Hyderabad, Telangana, India data Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing complex data product components based on requirements with possible technical solutions.Key ResponsibilitiesDesign and implement data processing programs using Python (e.g.,...


  • Hyderabad, Telangana, India data Full time

    Unlock the Power of Data with UsWe're seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative analytics and data products. As a key member of our engineering team, you will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to design and implement complex data product...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India NTT DATA Services Full time

    Data Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...

  • Data Engineer

    1 month ago


    Hyderabad, Telangana, India NTT DATA Services Full time

    Job Title: Data Engineer - Big Data SpecialistAt NTT DATA Services, we are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing scalable Big Data ecosystems for our clients. Your expertise will help us build stable and highly optimized data systems, ensuring seamless data processing and...

  • Big Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Big Data EngineerJob Summary: We are seeking a skilled Big Data Engineer to design and implement data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Key Responsibilities:Design and implement data processing pipelines using Python and big data technologies.Develop and maintain data assets...


  • Hyderabad, Telangana, India Virtusa Full time

    Job Title: Data Processing Engineer - Python and Big DataJob Summary:Virtusa is seeking a skilled Data Processing Engineer - Python and Big Data to design and implement data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark. The ideal candidate will have experience with Airflow and Jenkins, and a strong...


  • Hyderabad, Telangana, India Virtusa Full time

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our Virtusa team. The ideal candidate will have expertise in designing and implementing data processing pipelines using Python and Scala programming languages, as well as big data technologies such as Hadoop, MapReduce, Hive, and Spark.Mandatory Skills:Design and implement data...

  • Senior Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Summary: We are seeking a highly skilled Python Big Data Engineer to join our team at Virtusa. The ideal candidate will have expertise in designing and implementing data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Key Responsibilities:Design and implement data processing pipelines: Using Python...

  • Big Data Engineer

    1 month ago


    Hyderabad, India TECHSTAR SOFTWARE DEVELOPMENT INDIA PVT LTD Full time

    Job Title: Big Data EngineerAs a Big Data Engineer at TECHSTAR SOFTWARE DEVELOPMENT INDIA PVT LTD, you will be responsible for designing and developing big data solutions that drive business growth and innovation.Key Responsibilities:Design and develop big data pipelines for data ingestion and transformation using Java, Scala, or Python.Partner with domain...

  • Big Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    About the Role:Vidpro Consultancy Services is seeking a highly skilled Big Data Engineer to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing large-scale Big Data architectures using Java and Python.Key Responsibilities:Design and implement Big Data architectures using Hadoop and SparkDevelop...

  • Big Data Engineer

    1 month ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Summary We are seeking a highly skilled Big Data Engineer to join our team at Virtusa. The ideal candidate will have experience in designing and implementing data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark. Key ResponsibilitiesDesign and implement data processing pipelines using Python and big...


  • Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    Job Title: Senior Big Data EngineerJob Summary: Vidpro Consultancy Services is seeking a highly skilled Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale big data architectures using Java, Python, and Hadoop technologies.Responsibilities:Design...

  • Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    Pyspark Data Engineer Job Description At Virtusa, we are seeking a skilled Data Engineer with expertise in Pyspark and big data technologies. The ideal candidate will have a strong understanding of data processing pipelines and experience with Python programming. Responsibilities include designing and implementing data processing pipelines using Pyspark,...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India ANB IT Solutions Pvt Ltd Full time

    Key ResponsibilitiesCollaborate with cross-functional teams to design, develop, and maintain big data solutions using Google Cloud Big Query. Key responsibilities include data ingestion, transformation, and analytics.Data Engineering and DevelopmentDevelop and maintain ETL/ELT processes to ensure data integrity and consistency. Utilize Google Cloud Composer,...


  • Hyderabad, Telangana, India Nisum Full time

    Job Title: Senior Big Data EngineerAbout the Role:We are seeking a highly skilled Senior Big Data Engineer to join our team at Nisum. As a key member of our engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems using Hadoop, Python, and other big data technologies.Key Responsibilities:- Design...

  • Big Data Engineer

    1 month ago


    Bangalore/Hyderabad, India VIDPRO CONSULTANCY SERVICES Full time

    This position will be a part of a growing team working towards building world class large scale Big Data architectures. This individual should have a sound understanding of programming principles, experience in programming in Java, Python or similar languages and can expect to spend a majority of their time coding. Experience : 4-7 Years. Location :...

  • Big data engineer

    5 months ago


    Hyderabad, India Virtusa Full time

    Big data engineer - CREQ189284 Description Position: Big data engineer Primary: big data concepts, aws, pyspark Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge...

  • Big Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India Nisum Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Nisum. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key ResponsibilitiesAnalyze complex business requirements and generate technical specifications to design or redesign complex software...