Big Data Developer

2 weeks ago

Hyderabad, India Talentgigs Full time

Role: Big Data Engineer.

Experience: 7 Years.

Location: Hyderabad(HYBRID).

NP: Immediate - 15 Days

Mandatory skills: GCP - Cloud - Big Data Engineer, Apache Airflow, Apache Spark, Scala.


Job Description:


Key Responsibilities:

● Design, develop, and maintain Big Data pipelines, ensuring data quality, reliability, and scalability.

● Utilize Apache Spark and Apache Airflow to build and manage data processing workflows.

● Lead and mentor team members in the development of data engineering projects.

● Collaborate with product managers and cross-functional teams to understand business requirements and translate them into data solutions.

● Create and maintain system designs for Big Data pipelines, incorporating best practices and scalability considerations.

● Collaborate with the data science and analytics teams to deliver high-quality data for analysis and reporting.

● Continuously evaluate and adopt new technologies and tools to enhance data engineering capabilities.

Qualifications:

● Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

● Proven experience (5+ years) in developing and implementing Big Data pipelines using Apache Spark and Apache Airflow.

● Experience with Google Cloud Platform (GCP).

● Strong programming skills in Scala, Python, and Java.

● Demonstrated leadership skills with the ability to lead and mentor team members.

● Experience in designing scalable Big Data pipeline systems.

● Excellent problem-solving and critical-thinking abilities.

● Strong communication and collaboration skills.

● Experience working in an Agile or Scrum development environment is a plus.

  • Opening for Big data Developer

    4 weeks ago

    Hyderabad, India @ Six Sigma Full time

    Job DetailsRequirement Type Permanent Job Title Opening for Big data Developer Job Level Executive - Non-Managerial Job Description Big data Developer No. of Openings 6 Job Domain IT Experience - Minimum - Maximum data Expected Date Of Joining 2023-11-16 Joining Time 5 Days Salary 54,167 Work Locations HyderabadRequired skillsBig data

  • Opening for Big data Developer

    1 month ago

    Hyderabad, India @ Six Sigma Full time

    Job Details Requirement Type Permanent Job Title Opening for Big data Developer Job Level Executive - Non-Managerial Job Description Big data Developer No. of Openings 6 Job Domain IT Experience - Minimum - Maximum data Expected Date Of Joining 2023-11-16 Joining Time 5 Days Salary 54,167 Work Locations Hyderabad Required skills Big data

  • Business Development Executive

    1 month ago

    Hyderabad, India Big Basket Full time

    Job Requirements Job Title: Business Development ExecutiveCompany Name: Big BasketLocation: Kandlakoya, HyderabadSalary: ₹20,000 - ₹30,000 per monthEmployment Type: Full TimeJob Description:Are you a dynamic and ambitious individual with a flair for sales? Look no further! Big Basket is seeking talented Business Development Executives to join our...

  • Opening for Big data Developer

    1 month ago

    hyderabad, India @ Six Sigma Full time

    Job Details Requirement Type Permanent Job Title Opening for Big data Developer Job Level Executive - Non-Managerial Job Description Big data Developer No. of Openings 6 Job Domain IT Experience - Minimum - Maximum data Expected Date Of Joining 2023-11-16 Joining Time 5 Days Salary 54,167 Work Locations Hyderabad Required skills Big...

  • Scala Developer

    2 days ago

    Hyderabad, India Trinity Infotech INC Full time

    Job Description :- 5+ years of experience working in a software product development organization building modern and scalable big data applications.- Expertise with Scala functional programming (intermediate/advanced level is a mandate).- Data structures and algorithms in Scala.- Fluency in Hadoop technologies around handling big data processing e.g. Spark.-...

  • Scala Developer

    1 day ago

    Hyderabad, Telangana, India Trinity Infotech INC Full time

    Job Description :- 5+ years of experience working in a software product development organization building modern and scalable big data applications.- Expertise with Scala functional programming (intermediate/advanced level is a mandate).- Data structures and algorithms in Scala.- Fluency in Hadoop technologies around handling big data processing e.g. Spark.-...

  • Scala Developer

    2 days ago

    Hyderabad, India Trinity Infotech INC Full time

    Job Description : - 5+ years of experience working in a software product development organization building modern and scalable big data applications.- Expertise with Scala functional programming (intermediate/advanced level is a mandate).- Data structures and algorithms in Scala.- Fluency in Hadoop technologies around handling big data processing e.g....

  • Big Data Developer

    1 month ago

    hyderabad, India Corporate Resources Full time

    Job Description Responsibilities ::: We are looking for a Sr. Big Data Developer for large-scale, high-speed, and low-latency data solutions in the areas of: - Large scale data manipulation / ETL . - Mentor junior developers in SDLC process. - Long-term data storage / data warehousing. ...

  • Big data spark

    1 month ago

    Hyderabad, India Virtusa Full time

    Big data spark - CREQ178115 Description Position: Big data spark developer Primary skills: Big data spark & Java Location: Hyderabad & Bangalore Essential: 5+ years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive) Experience in writing SQL for any one relation database Extensive knowledge in HiveSQL Hadoop, SQL Experience in DevOps...

  • Big data spark

    1 month ago

    hyderabad, India Virtusa Full time

    Big data spark - CREQ178115 Description Position: Big data spark developer Primary skills: Big data spark & Java Location: Hyderabad & Bangalore Essential:5+ years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps...

  • Big data Developer

    4 weeks ago

    Hyderabad, Telangana, India State Street Full time

    Job TitleTechnical Manager - Big data technologiesRole Summary &Role DescriptionTechnical Manager with specific Hadoop stack - Impala , Hive, HBase, Spark, Sqoop ,Java, Oracle, and Micro services skills for trading application development. Analyzes, designs, develops and maintains software applications to support business units.Requires knowledge of Hadoop...

  • Big data spark developer

    4 weeks ago

    Hyderabad, India Virtusa Full time

    Big data spark developer - CREQ180562 Description Essential:5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps process (CICD, Jira, Bitbucket)Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary...

  • Big data spark

    4 weeks ago

    Hyderabad, India Virtusa Full time

    Big data spark - CREQ178115 DescriptionPosition: Big data spark developerPrimary skills: Big data spark & JavaLocation: Hyderabad & BangaloreEssential:5+ years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps process (CICD,...

  • Big data spark developer

    1 month ago

    Hyderabad, India Virtusa Full time

    Big data spark developer - CREQ180562 Description Essential: 5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive) Experience in writing SQL for any one relation database Extensive knowledge in HiveSQL Hadoop, SQL Experience in DevOps process (CICD, Jira, Bitbucket) Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced...

  • Big data spark developer

    1 month ago

    hyderabad, India Virtusa Full time

    Big data spark developer - CREQ180562 Description Essential:5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps process (CICD, Jira, Bitbucket) Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced...

  • Big data lead engineer

    7 days ago

    Hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 DescriptionPosition: Big data engineerPrimary skills: Big data, Pyspark, AWSLocation: HYDCreate Trigger based automation framework for Data MigrationIdentify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the sameIntegrate CDMS framework with Lake and Data bridge APIData...

  • Java Developer

    22 hours ago

    Hyderabad/Telangana, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities :- Develop and implement efficient Java code to optimize and enhance functionalities within our Trino (or Presto) platform.- Demonstrate excellent understanding of Java programming language and object-oriented programming (OOP) principles.- Possess strong code comprehension skills to effectively read and analyze open-source code like Trino.-...

  • Java Developer

    1 day ago

    Hyderabad/Telangana, Telangana, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities :- Develop and implement efficient Java code to optimize and enhance functionalities within our Trino (or Presto) platform.- Demonstrate excellent understanding of Java programming language and object-oriented programming (OOP) principles.- Possess strong code comprehension skills to effectively read and analyze open-source code like Trino.-...

  • Big data lead engineer

    2 weeks ago

    hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 Description Position: Big data engineer Primary skills: Big data, Pyspark, AWS Location: HYD Create Trigger based automation framework for Data MigrationIdentify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the sameIntegrate CDMS framework with Lake and Data...

  • Big data lead engineer

    2 weeks ago

    Hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 Description Position: Big data engineer Primary skills: Big data, Pyspark, AWS Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data...