Big data lead developer

4 weeks ago

Bengaluru, India Virtusa Full time
Big data lead developer - CREQ185814 Description

Position: Big data developerPrimary skills: hadoop, spark, Ab initioLocation: BLRExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop, Bigdata cluster with all services.Resource must have handson development experience with various Ab Initio components such as Rollup Scan join Partition by key Partition by Round Robin Gather Merge Interleave Lookup etc.Development Coding Unit testing using Ab Initio.Must have experience with SQL database programming SQL performance tuning relational model analysis.Good knowledge in developing UNIX scripts Oracle SQLPLSQL.Should be able to provide oversight and technical guidance for developers on Ab Initio.Good working knowledge in utilities like BTEQ FAST EXPORT FAST LOAD and MULTILOAD. Experience of Optimizing Teradata SQLPerformed database health checks and tuned the databases using Teradata Manager.Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of vast data stores. Good understanding of cloud technology. Must have strong technical experience in Design Mapping specifications HLD LLD. Must have the ability to relate to both business and technical members of the team and possess excellent communication skills. Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs.Develop and maintain data platforms using PythonWork with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrityCollaborate with crossfunctional teams to understand data requirements and design solutions that meet business needsImplement and manage agents for monitoring, logging, and automation within AWS environmentsHandling migration from PySpark to AWSPrimary Location Bangalore, Karnataka, India Job Type Experienced Primary Skills Python, PySpark, Java Years of Experience 8 Qualification

Education qualification: Any degree or equivalentExperience: 7+ yearsTravel No

  • Big Data Developer

    4 weeks ago

    Bengaluru, India Unison Consulting Pte Ltd Full time

    Job Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big data developer

    1 month ago

    Bengaluru, India Virtusa Full time

    Big data developer - CREQ185815 Description Position: Big data developer Primary skills: Hadoop, hive, spark, aws Location: BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like...

  • Big Data Developer

    1 month ago

    Bengaluru, India Unison Consulting Pte Ltd Full time

    Job Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big data developer

    4 weeks ago

    Bengaluru, India Virtusa Full time

    Big data developer - CREQ185815 DescriptionPosition: Big data developerPrimary skills: Hadoop, hive, spark, awsLocation: BLRExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka....

  • Big Data Developer

    4 weeks ago

    Bengaluru, India BigShyft Full time

    JobDescription:We are seeking askilled and experienced Big Data Developer/Data Engineer to joinour clients team in Bengaluru. The ideal candidate should have astrong background in Java Spark Hadoop and Scala with 47 years ofrelevant workexperience.Responsibilities:Designdevelop and maintain largescale data processing systems leveragingHadoop Spark and other...

  • Big Data Engineer

    2 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 14, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities:· Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...

  • Big Data Engineer

    1 day ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 16, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities:· Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...

  • Big Data Engineer

    4 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 14, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    3 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 16, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Developer

    1 week ago

    Bengaluru, India HTC Global Services Full time

    About HTC Global ServicesHTC Global Services is a US based IT solutions and IT enabled services company with its global headquarters in Troy, MI. We are an Inc 500 Hall of Fame company with our existence in the industry for three decades. HTC is a SEI-CMM Level 5 and ISO 9001 & ISO 27001 certified organization. HTC has its global presence in North America,...

  • Big Data Developer

    5 days ago

    Bengaluru, India HTC Global Services Full time

    About HTC Global ServicesHTC Global Services is a US based IT solutions and IT enabled services company with its global headquarters in Troy, MI. We are an Inc 500 Hall of Fame company with our existence in the industry for three decades. HTC is a SEI-CMM Level 5 and ISO 9001 & ISO 27001 certified organization. HTC has its global presence in North America,...

  • Big Data Developer

    1 month ago

    Bengaluru, India Tavant Full time

    With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and...

  • Big Data Developer

    1 month ago

    Bengaluru, India Tavant Full time

    With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and...

  • Big Data Developer

    1 month ago

    Bengaluru, India Tavant Full time

    With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and...

  • Big Data Developer

    1 week ago

    Bengaluru, India HTC Global Services Full time

    About HTC Global ServicesHTC Global Services is a US based IT solutions and IT enabled services company with its global headquarters in Troy, MI. We are an Inc 500 Hall of Fame company with our existence in the industry for three decades. HTC is a SEI-CMM Level 5 and ISO 9001 & ISO 27001 certified organization. HTC has its global presence in North America,...

  • Big Data Engineer

    2 days ago

    Bengaluru, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible....

  • Big Data Engineer

    21 hours ago

    Bengaluru, India Virtusa Full time

    Big Data Engineer - CREQ188642 DescriptionLooking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible.Bachelor's...

  • Big Data Developer

    6 days ago

    Bengaluru, India HTC Global Services Full time

    4+ years IT experience with minimum 2 years in Spark and Big Data platform Experience in Big Data technologies Hadoop, HDFS, Hive, Yarn, Jenkins, Ansible Expertise on Data processing, Orchestration, Parallelization, and Transformation Expertise in Spark Job, Joblets and Scala based custom components Should have knowledge of error handling and Performance...

  • Big Data Developer

    7 days ago

    Bengaluru, India HTC Global Services Full time

    4+ years IT experience with minimum 2 years in Spark and Big Data platform Experience in Big Data technologies Hadoop, HDFS, Hive, Yarn, Jenkins, AnsibleExpertise on Data processing, Orchestration, Parallelization, and TransformationExpertise in Spark Job, Joblets and Scala based custom componentsShould have knowledge of error handling and Performance tuning...

  • Big Data Developer

    2 weeks ago

    Bengaluru, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...