Big data lead developer

2 weeks ago

Hyderabad, India Virtusa Full time
Big data lead developer - CREQ185814 Description

Position: Big data developerPrimary skills: hadoop, spark, Ab initioLocation: BLRExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop, Bigdata cluster with all services.Resource must have handson development experience with various Ab Initio components such as Rollup Scan join Partition by key Partition by Round Robin Gather Merge Interleave Lookup etc.Development Coding Unit testing using Ab Initio.Must have experience with SQL database programming SQL performance tuning relational model analysis.Good knowledge in developing UNIX scripts Oracle SQLPLSQL.Should be able to provide oversight and technical guidance for developers on Ab Initio.Good working knowledge in utilities like BTEQ FAST EXPORT FAST LOAD and MULTILOAD. Experience of Optimizing Teradata SQLPerformed database health checks and tuned the databases using Teradata Manager.Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of vast data stores. Good understanding of cloud technology. Must have strong technical experience in Design Mapping specifications HLD LLD. Must have the ability to relate to both business and technical members of the team and possess excellent communication skills. Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs.Develop and maintain data platforms using PythonWork with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrityCollaborate with crossfunctional teams to understand data requirements and design solutions that meet business needsImplement and manage agents for monitoring, logging, and automation within AWS environmentsHandling migration from PySpark to AWSPrimary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary Skills Python, PySpark, Java Years of Experience 8 Qualification

Education qualification: Any degree or equivalentExperience: 7+ yearsTravel No

  • Big data lead engineer

    2 weeks ago

    hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 Description Position: Big data engineer Primary skills: Big data, Pyspark, AWS Location: HYD Create Trigger based automation framework for Data MigrationIdentify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the sameIntegrate CDMS framework with Lake and Data...

  • Big data lead engineer

    2 weeks ago

    Hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 Description Position: Big data engineer Primary skills: Big data, Pyspark, AWS Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data...

  • Big data lead engineer

    7 days ago

    Hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 DescriptionPosition: Big data engineerPrimary skills: Big data, Pyspark, AWSLocation: HYDCreate Trigger based automation framework for Data MigrationIdentify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the sameIntegrate CDMS framework with Lake and Data bridge APIData...

  • Lead Big Data Software Engineer

    1 month ago

    Hyderabad, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that...

  • Opening for Big data Developer

    4 weeks ago

    Hyderabad, India @ Six Sigma Full time

    Job DetailsRequirement Type Permanent Job Title Opening for Big data Developer Job Level Executive - Non-Managerial Job Description Big data Developer No. of Openings 6 Job Domain IT Experience - Minimum - Maximum data Expected Date Of Joining 2023-11-16 Joining Time 5 Days Salary 54,167 Work Locations HyderabadRequired skillsBig data

  • Opening for Big data Developer

    1 month ago

    Hyderabad, India @ Six Sigma Full time

    Job Details Requirement Type Permanent Job Title Opening for Big data Developer Job Level Executive - Non-Managerial Job Description Big data Developer No. of Openings 6 Job Domain IT Experience - Minimum - Maximum data Expected Date Of Joining 2023-11-16 Joining Time 5 Days Salary 54,167 Work Locations Hyderabad Required skills Big data

  • Opening for Big data Developer

    1 month ago

    hyderabad, India @ Six Sigma Full time

    Job Details Requirement Type Permanent Job Title Opening for Big data Developer Job Level Executive - Non-Managerial Job Description Big data Developer No. of Openings 6 Job Domain IT Experience - Minimum - Maximum data Expected Date Of Joining 2023-11-16 Joining Time 5 Days Salary 54,167 Work Locations Hyderabad Required skills Big...

  • Business Development Executive

    1 month ago

    Hyderabad, India Big Basket Full time

    Job Requirements Job Title: Business Development ExecutiveCompany Name: Big BasketLocation: Kandlakoya, HyderabadSalary: ₹20,000 - ₹30,000 per monthEmployment Type: Full TimeJob Description:Are you a dynamic and ambitious individual with a flair for sales? Look no further! Big Basket is seeking talented Business Development Executives to join our...

  • Scala Developer

    2 days ago

    Hyderabad, India Trinity Infotech INC Full time

    Job Description :- 5+ years of experience working in a software product development organization building modern and scalable big data applications.- Expertise with Scala functional programming (intermediate/advanced level is a mandate).- Data structures and algorithms in Scala.- Fluency in Hadoop technologies around handling big data processing e.g. Spark.-...

  • Scala Developer

    2 days ago

    Hyderabad, India Trinity Infotech INC Full time

    Job Description : - 5+ years of experience working in a software product development organization building modern and scalable big data applications.- Expertise with Scala functional programming (intermediate/advanced level is a mandate).- Data structures and algorithms in Scala.- Fluency in Hadoop technologies around handling big data processing e.g....

  • Scala Developer

    1 day ago

    Hyderabad, Telangana, India Trinity Infotech INC Full time

    Job Description :- 5+ years of experience working in a software product development organization building modern and scalable big data applications.- Expertise with Scala functional programming (intermediate/advanced level is a mandate).- Data structures and algorithms in Scala.- Fluency in Hadoop technologies around handling big data processing e.g. Spark.-...

  • Big data Developer

    4 weeks ago

    Hyderabad, Telangana, India State Street Full time

    Job TitleTechnical Manager - Big data technologiesRole Summary &Role DescriptionTechnical Manager with specific Hadoop stack - Impala , Hive, HBase, Spark, Sqoop ,Java, Oracle, and Micro services skills for trading application development. Analyzes, designs, develops and maintains software applications to support business units.Requires knowledge of Hadoop...

  • Big Data Developer

    1 month ago

    hyderabad, India Corporate Resources Full time

    Job Description Responsibilities ::: We are looking for a Sr. Big Data Developer for large-scale, high-speed, and low-latency data solutions in the areas of: - Large scale data manipulation / ETL . - Mentor junior developers in SDLC process. - Long-term data storage / data warehousing. ...

  • Big data Developer

    2 weeks ago

    Hyderabad, India State Street Full time

    Job TitleTechnical Manager - Big data technologiesRole Summary &Role DescriptionTechnical Manager with specific Hadoop stack - Impala , Hive, HBase, Spark, Sqoop ,Java, Oracle, and Micro services skills for trading application development. Analyzes, designs, develops and maintains software applications to support business units.Requires knowledge of Hadoop...

  • Big Data Platform Engineer

    1 month ago

    hyderabad, India Apple Full time

    Summary:The people here at Apple don’t just build products — we craft the kind of wonder that’s revolutionized entire industries. It’s the diversity of those people and their ideas that supports the innovation that runs through everything we do, from amazing technology to industry-leading environmental efforts. Join Apple, and help us leave the world...

  • Big data spark

    1 month ago

    Hyderabad, India Virtusa Full time

    Big data spark - CREQ178115 Description Position: Big data spark developer Primary skills: Big data spark & Java Location: Hyderabad & Bangalore Essential: 5+ years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive) Experience in writing SQL for any one relation database Extensive knowledge in HiveSQL Hadoop, SQL Experience in DevOps...

  • Big data spark

    1 month ago

    hyderabad, India Virtusa Full time

    Big data spark - CREQ178115 Description Position: Big data spark developer Primary skills: Big data spark & Java Location: Hyderabad & Bangalore Essential:5+ years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps...

  • Big data Developer

    1 month ago

    Hyderabad, India State Street Full time

    Job Title Technical Manager - Big data technologies Role Summary &Role Description Technical Manager with specific Hadoop stack - Impala , Hive, HBase, Spark, Sqoop ,Java, Oracle, and Micro services skills for trading application development. Analyzes, designs, develops and maintains software applications to support business units. Requires...

  • Big data Developer

    1 month ago

    hyderabad, India State Street Full time

    Job Title Technical Manager - Big data technologies Role Summary &Role Description Technical Manager with specific Hadoop stack - Impala , Hive, HBase, Spark, Sqoop ,Java, Oracle, and Micro services skills for trading application development. Analyzes, designs, develops and maintains software applications to support business units. Requires...

  • Big Data Solution Architect

    4 weeks ago

    Hyderabad, India Epam Full time

    DescriptionEPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver...