Big Data Python Engineer

3 days ago


Hyderabad, India Virtusa Full time
Big Data Python Engineer - CREQ191701 Description Role GDT WS Big Data Python Engineer
Exp 5+
Location Pune/Hyderabad

MUST Have Skills
Design and implement data processing pipelines using Python + SCALA programming and big data technologies such as Hadoop, MapReduce, Hive, and Spark.
Airflow
Jenkins
Understand business requirements to code up data assets in pyspark. Design, develop, test, and maintain data assets.
Troubleshoot, debug, and optimise data pipelines for maximum performance and scalability.
Collaborate with data and business analysts to implement data solutions that meet business requirements.

Nice to have skills
API experience Java
Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary Skills PySpark Years of Experience 5 Qualification

Role GDT WS Big Data Python Engineer
Exp 5+
Location Pune/Hyderabad

MUST Have Skills
Design and implement data processing pipelines using Python + SCALA programming and big data technologies such as Hadoop, MapReduce, Hive, and Spark.
Airflow
Jenkins
Understand business requirements to code up data assets in pyspark. Design, develop, test, and maintain data assets.
Troubleshoot, debug, and optimise data pipelines for maximum performance and scalability.
Collaborate with data and business analysts to implement data solutions that meet business requirements.

Nice to have skills
API experience Java

Travel No

  • hyderabad, India Virtusa Full time

    Big Data Python Engineer - CREQ191701 Description Role GDT WS Big Data Python EngineerExp 5+Location Pune/HyderabadMUST Have SkillsDesign and implement data processing pipelines using Python + SCALA programming and big data technologies such as Hadoop, MapReduce, Hive, and Spark.AirflowJenkinsUnderstand business requirements to code up data assets in...


  • Hyderabad, Telangana, India data Full time

    What can you tell your friends when they ask you what you do? We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...


  • Hyderabad, Telangana, India data Full time

    What can you tell your friendswhen they ask you what you do?We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...


  • Hyderabad, India Virtusa Full time

    Big Data Python Engineer - CREQ191701 Description Role GDT WS Big Data Python EngineerExp 5+Location Pune/HyderabadMUST Have SkillsDesign and implement data processing pipelines using Python + SCALA programming and big data technologies such as Hadoop, MapReduce, Hive, and Spark.AirflowJenkinsUnderstand business requirements to code up data assets in...


  • Hyderabad, Telangana, India data Full time

    What can you tell your friends when they ask you what you do? "As a Data Analyst at , I help analyze, monitor, and deliver comprehensive and high-quality app market data to app professionals. I am empowered to work independently with the support of team members spread across APAC, AMER, and EMEA. I am the key contributor to the new and existing product...

  • Big data engineer

    4 weeks ago


    Hyderabad, India Virtusa Full time

    Big data engineer - CREQ189307 Description Position: Big data engineer Primary skills: Big data, aws Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge API Data...

  • Big data engineer

    1 month ago


    Hyderabad, India Virtusa Full time

    Big data engineer - CREQ189307 Description Position: Big data engineer Primary skills: Big data, aws Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge API Data...

  • Big data engineer

    4 weeks ago


    hyderabad, India Virtusa Full time

    Big data engineer - CREQ189307 Description Position: Big data engineer Primary skills: Big data, aws Location: HYD Create Trigger based automation framework for Data MigrationIdentify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the sameIntegrate CDMS framework with Lake and Data bridge APIData...

  • Big data engineer

    2 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    Big data engineer - CREQ189307 Description Position: Big data engineer Primary skills: Big data, aws Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge API Data...

  • Big data engineer

    7 days ago


    hyderabad, India Virtusa Full time

    Big data engineer - CREQ189284 Description Position: Big data engineer Primary: big data concepts, aws, pyspark Location: HYD Create Trigger based automation framework for Data MigrationIdentify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the sameIntegrate CDMS framework with Lake and Data...

  • Big data engineer

    7 days ago


    Hyderabad, India Virtusa Full time

    Big data engineer - CREQ189284 Description Position: Big data engineer Primary: big data concepts, aws, pyspark Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge...

  • Big Data Engineer

    8 hours ago


    Hyderabad/Gurgaon/Gurugram, IN Truviq Systems Full time

    Role : Big Data Engineer :Skills : Data Skills and Qualifications :Exp : 5- 8 yearsMax Notice : Immediate to 15 daysLocation : Hyderabad / GurgaonClient : VirtusaPay Roll company : Truviq System- Bachelor's degree in Computer Science, Information Technology, or a related field.- 5+ years of experience in data engineering or a similar role.- Proficiency...

  • Big data engineer

    2 days ago


    Hyderabad, India Virtusa Full time

    Big data engineer - CREQ189284 DescriptionPosition: Big data engineerPrimary: big data concepts, aws, pysparkLocation: HYDCreate Trigger based automation framework for Data MigrationIdentify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the sameIntegrate CDMS framework with Lake and Data bridge APIData...


  • Hyderabad, India Tiger Analytics Full time

    Job DescriptionAbout the role:We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as...


  • Hyderabad, India Tiger Analytics Full time

    Job DescriptionWe are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch processing...

  • Big data lead engineer

    2 months ago


    Hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 Description Position: Big data engineer Primary skills: Big data, Pyspark, AWS Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data...


  • hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 Description Position: Big data engineer Primary skills: Big data, Pyspark, AWS Location: HYD Create Trigger based automation framework for Data MigrationIdentify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the sameIntegrate CDMS framework with Lake and Data...


  • Hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 Description Position: Big data engineer Primary skills: Big data, Pyspark, AWS Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data...


  • hyderabad, India Tiger Analytics Full time

    Job Description We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch...


  • Hyderabad, India Tiger Analytics Full time

    Job Description We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch...