Lead - Big Data Developer

3 months ago


Hyderabad, India Virtusa Full time
Lead - Big Data Developer - CREQ189749 Description

Job Description:
5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive
Bachelors or masters degree in Computer Science or related field
Strong knowledge of working with large data sets and high-capacity big data processing platform
Strong experience in Unix and Shell scripting
Advanced knowledge of the Hadoop ecosystem and its components
In-depth knowledge of Hive, Shell scripting, Python, Spark
Ability to write MapReduce jobs
Experience using Job Schedulers like Autosys
Hands on experience in HiveQL
Good knowledge on Hadoop Architecture and HDFS
Strong knowledge of working with large data sets and high-capacity big data processing platform
Strong experience in Unix and Shell scripting
Experience with jenkins for Continuous Integration
Experience using Source Code and Version Control Systems like Bitbucket, Git
Good to have experience on Agile Development
Responsibilities: Develop components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained
Ensures solutions are well designed with maintainability/ease of integration and testing built-in from the outset
Participates and guides team in estimating work necessary to realize a story/requirement through the software delivery lifecycle
Responsible for developing and delivering complex software requirements to accomplish business goals
Ensures that software is developed to meet functional, non-functional, and compliance requirements
Codes solutions, Unit testing and ensure the solution can be integrated successfully into the overall application/system with clear robust, and well-tested interfaces

Required Skills: Hadoop, Hive, HDFS, Spark, Python, Unix

Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary Skills ANSI SQL Years of Experience 5 Travel No
  • Big Data Developer

    4 months ago


    Hyderabad, India Virtusa Full time

    Big Data Developer - CREQ189736 Description Job Description: 5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Bachelors or masters degree in Computer Science or related field Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience...

  • Big Data Lead

    1 month ago


    Hyderabad, India Lovoro Tech Full time

    The Role :We are looking for an experienced and highly skilled Big Data Lead to join our team and drive the design, implementation, and management of our big data infrastructure. The ideal candidate will have a deep understanding of data lake architectures, big data technologies, and data engineering processes. This role requires expertise in handling...

  • Big Data Engineer

    1 month ago


    Hyderabad, India NucleusTeq Full time

    Big Data Engineer Responsibilities: Big Data Engineer with 5-6 years of experienceExperience in leading a team of engineers and a good attitude toward learning the domain and implementationStrong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.Finalizing the scope of the system and delivering...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, India NucleusTeq Full time

    Big Data Engineer Responsibilities: Big Data Engineer with 5+ years of experienceExperience in leading a team of engineers and a good attitude toward learning the domain and implementationStrong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.Finalizing the scope of the system and delivering...


  • Hyderabad, India @ Six Sigma Full time

    Job Details Requirement Type Permanent Job Title Opening for Big data Developer Job Level Executive - Non-Managerial Job Description Big data Developer No. of Openings 6 Job Domain IT Experience - Minimum - Maximum data Expected Date Of Joining 2023-11-16 Joining Time 5 Days Salary 54,167 Work Locations Hyderabad Required skills Big data

  • Big data engineer

    3 months ago


    Hyderabad, India Virtusa Full time

    Big data engineer - CREQ189284 Description Position: Big data engineer Primary: big data concepts, aws, pyspark Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge...


  • Hyderabad, India Tetrahed INC Full time

    Key ResponsibilitiesDesigning and implementing scalable highperformance GCPbased big data solutionsLeading architecture design discussions with stakeholders to understand requirements and align on solutionsDeveloping data pipelines and ETL processes to move transform and aggregate large volumes of dataOptimizing data storage retrieval and processing using...

  • Data Developer

    2 months ago


    Hyderabad, India Selsoftinc Full time

    Responsibilities :- Experience in a Big Data technologies (Spark, Redshift, Kafka, etc.)- Experience programming in JAVA and Python- Experience performing data analysis (NOT DATA SCIENCE) on AWS platforms- Experience with data management process on AWS is a huge Plus- Experience in implementing complex ETL transformations on AWS using Glue- Familiarity with...


  • Hyderabad, India Findernest Software Services Pvt Ltd Full time

    Overview:The Senior Big Data Engineer plays a crucial role in our organization responsible for designing developing and maintaining scalable big data solutions. This role is essential in harnessing the power of data to drive informed business decisions and strategic initiatives.Key Responsibilities:Design and implement big data solutions using technologies...


  • Hyderabad, India Tetrahed INC Full time

    KeyResponsibilitiesDesigning andimplementing scalable highperformance GCPbased big datasolutionsLeading architecture designdiscussions with stakeholders to understand requirements and alignon solutionsDeveloping data pipelines and ETLprocesses to move transform and aggregate large volumes ofdataOptimizing data storage retrieval andprocessing using GCP...

  • Big Data Engineer

    3 days ago


    Hyderabad, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full time

    Job Summary:We are seeking a skilled and innovative Big Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data processing systems. You will work with large datasets and implement data pipelines to ensure data quality and availability for analytics and business intelligence...

  • Big Data Engineer

    1 week ago


    hyderabad, India Anblicks Full time

    4-6 years of experience: Experience in hadoop/big data technologies. experience in spark. experience in Snowflake experience working on Google or AWS cloud developing data solutions. Certifications preferred. Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required; Experience with containerization and related...


  • Hyderabad, India Findernest Software Services Pvt Ltd Full time

    Overview:The SeniorBig Data Engineer plays a crucial role in our organizationresponsible for designing developing and maintaining scalable bigdata solutions. This role is essential in harnessing the power ofdata to drive informed business decisions and strategicinitiatives.KeyResponsibilities:Design andimplement big data solutions using technologies such as...

  • AWS Big Data Engineer

    3 months ago


    Hyderabad, India Tiger Analytics Full time

    Job Description We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch...

  • Big Data Engineer

    4 weeks ago


    hyderabad, India Anblicks Full time

    4-6 years of experience:Experience in hadoop/big data technologies.experience in spark.experience in Snowflakeexperience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies...


  • Hyderabad, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that...

  • GCP Big Data Engineer

    2 months ago


    Hyderabad, India Tetrahed INC Full time

    Relevant experience for engagement: 10Years Relevant skillset: Maintain architecture principles guidelinesand standards Data Warehousing Programming Language: Python/Java Big Data DataAnalytics GCP ServicesRelevanttechnology domains: Experience in designing& implementing solution in mentioned areas: Strong GoogleCloud Platform Data Components BigQuery...

  • Big Data Engineer

    4 weeks ago


    Hyderabad, India Anblicks Full time

    4-6 years of experience:Experience in hadoop/big data technologies.experience in spark.experience in Snowflakeexperience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies...

  • Big Data Engineer

    1 week ago


    hyderabad, India Anblicks Full time

    4-6 years of experience:Experience in hadoop/big data technologies.experience in spark.experience in Snowflakeexperience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies...

  • Big Data Engineer

    4 weeks ago


    Hyderabad, India Anblicks Full time

    4-6 years of experience: Experience in hadoop/big data technologies. experience in spark. experience in Snowflake experience working on Google or AWS cloud developing data solutions. Certifications preferred. Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required; Experience with containerization and related...