Big data lead developer

Found in: Whatjobs IN C2 - 3 weeks ago


bangalore, India Virtusa Full time
Big data lead developer - CREQ185814 Description Position: Big data developer Primary skills: hadoop, spark, Ab initio Location: BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop, Bigdata cluster with all services.
Resource must have handson development experience with various Ab Initio components such as Rollup Scan join Partition by key Partition by Round Robin Gather Merge Interleave Lookup etc.
Development Coding Unit testing using Ab Initio.
Must have experience with SQL database programming SQL performance tuning relational model analysis.
Good knowledge in developing UNIX scripts Oracle SQLPLSQL.
Should be able to provide oversight and technical guidance for developers on Ab Initio.
Good working knowledge in utilities like BTEQ FAST EXPORT FAST LOAD and MULTILOAD. Experience of Optimizing Teradata SQL
Performed database health checks and tuned the databases using Teradata Manager.
Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of vast data stores. Good understanding of cloud technology. Must have strong technical experience in Design Mapping specifications HLD LLD. Must have the ability to relate to both business and technical members of the team and possess excellent communication skills. Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs.
Develop and maintain data platforms using Python
Work with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrity
Collaborate with crossfunctional teams to understand data requirements and design solutions that meet business needs
Implement and manage agents for monitoring, logging, and automation within AWS environments
Handling migration from PySpark to AWS Primary Location Bangalore, Karnataka, India Job Type Experienced Primary Skills Python, PySpark, Java Years of Experience 8 Qualification Education qualification: Any degree or equivalent Experience: 7+ years Travel No
  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago


    bangalore, India Virtusa Full time

    Big Data Developer - CREQ181026 Description Lead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production MetrologyLead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production Metrology Primary Location Bangalore, Karnataka, India Job Type...

  • Big Data Developer

    Found in: Talent IN 2A C2 - 3 weeks ago


    Bangalore Metropolitan Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQLExtensive experience with Python and PySpark for data processing and...

  • Big data developer

    Found in: Whatjobs IN C2 - 3 weeks ago


    bangalore, India Virtusa Full time

    Big data developer - CREQ185815 Description Position: Big data developer Primary skills: Hadoop, hive, spark, aws Location: BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago


    bangalore, India Unison Consulting Pte Ltd Full time

    Job Description: Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 2 weeks ago


    bangalore, India BigShyft Full time

    JobDescription: We are seeking askilled and experienced Big Data Developer/Data Engineer to joinour clients team in Bengaluru. The ideal candidate should have astrong background in Java Spark Hadoop and Scala with 47 years ofrelevant workexperience.Responsibilities: Designdevelop and maintain largescale data processing systems leveragingHadoop Spark and...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago


    bangalore, India Grid Dynamics Full time

    Java Big Data Engineer We are seeking a strong Java Big Data Engineer with good technical expertise, to be responsible for the quality of a highly scalable and distributed platform. Objectives of this role Develop and implement pipelines that extract, transform, and load data into an information product that helps the organization reach its strategic...

  • Big data architect

    Found in: Whatjobs IN C2 - 3 weeks ago


    bangalore, India Virtusa Full time

    Big data architect - CREQ185795 Description Position: Big data architect Location: BLR Primary skills: Big data hadoop spark & aws Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig...

  • Big Data Architect

    Found in: Whatjobs IN C2 - 3 weeks ago


    bangalore, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. ...

  • Big Data Engineer

    Found in: Whatjobs IN C2 - 3 weeks ago


    Bangalore Urban, India Algonomy Full time

    Role : Big Data Engineer Years of experience : 5-8 years Location : Bangalore At Algonomy, we believe the future of our economy is Algorithmic, where businesses will develop resilient, adaptive and agile decisioning abilities that will constantly test and refine AI-driven actions to create the best personal experience for every individual customer at...

  • Senior Big Data Architect/Technical Lead

    Found in: Whatjobs IN C2 - 3 weeks ago


    Bangalore, India Sumeru Global Technologies Full time

    Job Title : Senior Big Data Architect and Technical Lead. Location : Bangalore. Job Description : We are seeking a highly skilled and experienced Senior Big Data Architect and Technical Lead to join our dynamic team. As a key member of our Big Data division, you will be responsible for providing technical leadership, guiding teams, and driving innovation in...

  • Senior Big Data Architect/Technical Lead

    Found in: Adzuna IN C2 - 2 weeks ago


    Bangalore, Karnataka, India Sumeru Global Technologies Full time

    Job Title : Senior Big Data Architect and Technical Lead. Location : Bangalore. Job Description : We are seeking a highly skilled and experienced Senior Big Data Architect and Technical Lead to join our dynamic team. As a key member of our Big Data division, you will be responsible for providing technical leadership, guiding teams, and driving innovation in...

  • Senior Big Data Architect/Technical Lead

    Found in: Whatjobs IN C2 - 4 days ago


    Bangalore, India Sumeru Global Technologies Full time

    Job Title : Senior Big Data Architect and Technical Lead. Location : Bangalore. Job Description : We are seeking a highly skilled and experienced Senior Big Data Architect and Technical Lead to join our dynamic team. As a key member of our Big Data division, you will be responsible for providing technical leadership, guiding teams, and driving innovation in...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago


    bangalore, India Nityo Infotech Full time

    •2+ or 4+ years of experience in the role of implementation of high end software products.•Sound knowledge of Kubernetes and deployment methodologies•Bigdata (Hdfs/hive/HBASE/KAFka), either of Spark/Pyspark is mandatory , with strong problem-solving skills, and able to thrive with minimal supervision.•Knowledge of database principles, SQL, and...

  • Big Data Engineer

    Found in: Whatjobs IN C2 - 3 weeks ago


    bangalore, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with...

  • Big Data Engineer

    Found in: Whatjobs IN C2 - 3 weeks ago


    bangalore, India Virtusa Full time

    Big Data Engineer - CREQ184231 Description Profile : 5-8 years IT experience with minimum 2 years in Spark and Big Data platform Experience in Big Data technologies Hadoop, HDFS, Hive, Yarn, Jenkins, Ansible Job DescriptionResponsibilitiesSkill: Spark, ScalaLevel: Senior Software EngineerCategory: Special/NicheTenure: 1 YearMission :He (or she) is in charge...

  • Quality Assurance Lead

    Found in: Whatjobs IN C2 - 3 weeks ago


    Bangalore, India TalentXo Full time

    Role & Responsibilities : Lead and manage the quality assurance, testing and verification efforts for our AI and Big Data analytics platform, ensuring the delivery of high-quality software within the defined timelines. Collaborate with cross-functional teams, including development, product management, customer success and business stakeholders, to...

  • Big Data Analyst

    Found in: Whatjobs IN C2 - 3 weeks ago


    bangalore, India Corporate Resources Full time

    Job Description  Big data analyst with knowledge of big data technologies and ability to analyze large volumes of data and bring out insights  Reporting and presenting on data insights  Handson knowledge of scripting and using Big data tools  Data analysis and processing ...

  • Big Data Specialist

    Found in: Whatjobs IN C2 - 1 day ago


    bangalore, India Sigmoid Full time

    Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We arelooking for a detailed oriented self-starter to assist our engineering and analytics teams invarious roles as a Software Development Engineer.This position will be a part of a growing team working towards building world class large scaleBig Data architectures. This...

  • Big Data Developer5 YearsBangaloreBTechBEOnly-Prachi

    Found in: Whatjobs IN C2 - 1 week ago


    bangalore, India Coders Brain Technology Pvt. Ltd. Full time

    CompanyOverview: Coders Brain Technology Pvt. Ltd.is a leading organization in the IT Services and IT Consultingindustry specializing in providing innovative datadrivensolutions.Role andResponsibilities: Working withina crossfunctional agile development team to deliver innovativecomponents for datadriven solutions Handsondevelopment using tools and...

  • Big Data Developer

    Found in: Whatjobs IN C2 - 3 weeks ago


    Gurgaon,Gurugram,Bangalore, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...