Big data lead developer

Found in: Talent IN C2 - 3 weeks ago

Bengaluru, India Virtusa Full time
Big data lead developer - CREQ185814 Description Position: Big data developer Primary skills: hadoop, spark, Ab initio Location: BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop, Bigdata cluster with all services.
Resource must have handson development experience with various Ab Initio components such as Rollup Scan join Partition by key Partition by Round Robin Gather Merge Interleave Lookup etc.
Development Coding Unit testing using Ab Initio.
Must have experience with SQL database programming SQL performance tuning relational model analysis.
Good knowledge in developing UNIX scripts Oracle SQLPLSQL.
Should be able to provide oversight and technical guidance for developers on Ab Initio.
Good working knowledge in utilities like BTEQ FAST EXPORT FAST LOAD and MULTILOAD. Experience of Optimizing Teradata SQL
Performed database health checks and tuned the databases using Teradata Manager.
Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of vast data stores. Good understanding of cloud technology. Must have strong technical experience in Design Mapping specifications HLD LLD. Must have the ability to relate to both business and technical members of the team and possess excellent communication skills. Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs.
Develop and maintain data platforms using Python
Work with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrity
Collaborate with crossfunctional teams to understand data requirements and design solutions that meet business needs
Implement and manage agents for monitoring, logging, and automation within AWS environments
Handling migration from PySpark to AWS Primary Location Bangalore, Karnataka, India Job Type Experienced Primary Skills Python, PySpark, Java Years of Experience 8 Qualification Education qualification: Any degree or equivalent Experience: 7+ years Travel No

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Bengaluru, India Aptus Data Labs Full time

    Job Title: Big Data DevelopersExperience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills ( Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem includingHDFS, Hive, and HSQLExtensive experience withPython and PySparkfor data processing and...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Virtusa Full time

    Big Data Developer - CREQ181026 Description Lead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production MetrologyLead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production MetrologyPrimary Location Bangalore, Karnataka, India Job Type...

  • Big data lead developer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Virtusa Full time

    Big data lead developer - CREQ185814 DescriptionPosition: Big data developerPrimary skills: hadoop, spark, Ab initioLocation: BLRExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop, Bigdata cluster with all services.Resource must have handson development experience with...

  • Big Data Developer

    Found in: Talent IN C2 - 3 weeks ago

    Bengaluru, India Virtusa Full time

    Big Data Developer - CREQ181026 Description Lead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production Metrology Lead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production Metrology Primary Location Bangalore, Karnataka,...

  • Big Data Developer

    Found in: Appcast Linkedin IN C2 - 3 weeks ago

    Greater Bengaluru Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQLExtensive experience with Python and PySpark for data processing and...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Greater Bengaluru Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 years Location: Remote / core location - Bangalore Mandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation ) Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQL Extensive experience with Python and PySpark for data processing and...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Unison Consulting Pte Ltd Full time

    Job Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big data developer

    Found in: Talent IN C2 - 3 weeks ago

    Bengaluru, India Virtusa Full time

    Big data developer - CREQ185815 Description Position: Big data developer Primary skills: Hadoop, hive, spark, aws Location: BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like...

  • Big data developer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India Virtusa Full time

    Big data developer - CREQ185815 DescriptionPosition: Big data developerPrimary skills: Hadoop, hive, spark, awsLocation: BLRExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka....

  • Big Data Developer

    Found in: Talent IN C2 - 3 weeks ago

    Bengaluru, India Unison Consulting Pte Ltd Full time

    Job Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big Data Developer

    Found in: Talent IN C2 - 2 weeks ago

    Bengaluru, India BigShyft Full time

    JobDescription:We are seeking askilled and experienced Big Data Developer/Data Engineer to joinour clients team in Bengaluru. The ideal candidate should have astrong background in Java Spark Hadoop and Scala with 47 years ofrelevant workexperience.Responsibilities:Designdevelop and maintain largescale data processing systems leveragingHadoop Spark and other...

  • BIG DATA Developer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Bengaluru, India IBCScorp Full time

    Please see below the JD for Bigdata developer:Candidate should be available to interview in person in BangaloreWorking within a cross functional, agile development team, this Big Data Developer will be responsible for hands on development and technical delivery of innovative components used in data driven solutions.The candidate will have a sound working...

  • Big Data Developer

    Found in: Talent IN C2 - 3 weeks ago

    Bengaluru, India IBCScorp Full time

    Hi,We are hiring for Bigdata Developer for one of our Prestigious Client @ Bangalore Location. Job Location: BangalorePosition: Big Data DeveloperExperience: 5+yrsTotal YOE: 5+ Years Technical Experience 2+ Years of experience with Big Query SQL. 4+ years of experience with Scala and SPARK. Very strong in SQL 4+ yrs Experience with GCP Cloud. Candidate...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Bengaluru, India Impetus Full time

    QualificationsBachelor's degree in engineering or computer science or equivalent OR master's in computer applications or equivalent.Solid Experience of software development experience and leading teams of engineers and scrum teams.3 years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and Java).Solid Data warehousing...

  • BIG DATA Developer

    Found in: Talent IN C2 - 3 weeks ago

    Bengaluru, India IBCScorp Full time

    Please see below the JD for Bigdata developer:Candidate should be available to interview in person in BangaloreWorking within a cross functional, agile development team, this Big Data Developer will be responsible for hands on development and technical delivery of innovative components used in data driven solutions.The candidate will have a sound working...

  • Big Data Engineer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Bengaluru, India Algonomy Full time

    Role :Big Data EngineerYears of experience : 5-8 yearsLocation : BangaloreAt Algonomy, we believe the future of our economy is Algorithmic, where businesses will develop resilient, adaptive and agile decisioning abilities that will constantly test and refine AI-driven actions to create the best personal experience for every individual customer at scale.We...

  • Big Data Developer

    Found in: Talent IN 2A C2 - 3 weeks ago

    Bengaluru, India Tavant Full time

    With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Bengaluru, India Tavant Full time

    With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and...

  • Big Data Developer

    Found in: Appcast Linkedin IN C2 - 3 weeks ago

    Bengaluru, India Tavant Full time

    With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Bengaluru, India Grid Dynamics Full time

    Java Big Data EngineerWe are seeking a strong Java Big Data Engineer with good technical expertise, to be responsible for the quality of a highly scalable and distributed platform.Objectives of this roleDevelop and implement pipelines that extract, transform, and load data into an information product that helps the organization reach its strategic...