Bigdata

4 weeks ago


bangalore, India Alp Consulting Limited Full time

Job description

We are looking for data engineers who have the right attitude, aptitude, skills, empathy, compassion, and hunger for learning Build products in the data analytics space A passion for shipping high-quality data products, an interest in the data products space; curiosity about the bigger picture of building a company, product development and its people

Roles and Responsibilities

  • Develop and manage robust ETL pipelines using Apache Spark (Scala)
  • Understand park concepts, performance optimization techniques and governance tools
  • Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data Warehouse/Data Lake/Data Mesh
  • Collaborate cross-functionally to design effective data solutions
  • Implement data workflows utilizing AWS Step Functions for efficient orchestration. Leverage AWS Glue and Crawler for seamless data cataloging and automation
  • Monitor, troubleshoot, and optimize pipeline performance and data quality
  • Maintain high coding standards and produce thorough documentation. Contribute to high-level (HLD) and low-level (LLD) design discussions
Requirements
  • Minimum 5 years of progressive experience building solutions in Big Data environments
  • Have a strong ability to build robust and resilient data pipelines which are scalable, fault tolerant and reliable in terms of data movement
  • 5+ years of hands-on expertise in Apache Spark (Scala)
  • Strong command of AWS services like Step Functions, AWS Glue, and AWS Crawler
  • Strong hands on capabilities on SQL and NoSQL technologies
  • Skilled in Scala, Python, or Java programming languages
  • Sound understanding of data warehousing, modeling, and ETL concepts
  • Familiarity with High-Level Design (HLD) and Low-Level Design (LLD) principles
  • Excellent written and verbal communication skills

Job Title:

Hi Applicants

Hiring for a Job in a Reputed Organization(Product and Service based company) .

Here is a Gateway to it, through ALP Consulting.

Recruiting

Employment Type: Permanent

Experience:

Skills Required:

  • Excellent Communication Skills
  • Strong Experience in :

Job Location: Pan India

Note: Maximum 60 Days Notice Period will be Prioritized.


  • Bigdata

    2 weeks ago


    bangalore, India Alp Consulting Limited Full time

    Must-Have 4+ years of Minimum experience in Bigdata Spark development projects Expertise in Spark (Either Pyspark or Spark Scala) and Hadoop Experience in Spark, SQL and Hive Good experience in Agile projects Good onsite Offshore communication Flexibility to work in complex work environment dealing with multiple stakeholders Good-to-Have ...

  • Data Developer

    6 days ago


    bangalore, India Airbus Full time

    Description:You will join the Airbus (DCS) organization in charge of the BigData Developments &Support. The mission of the PSL is to deliver innovative IT solutions that support digitaltransformation and efficient operations for customer services.More precisely the PSL is dedicated to support Customer Services activities related to theAirframe Services...

  • Data Developer

    4 days ago


    Bangalore City, India Airbus Full time

    Description:You will join the Airbus (DCS) organization in charge of the BigData Developments & Support. The mission of the PSL is to deliver innovative IT solutions that support digitaltransformation and efficient operations for customer services.More precisely the PSL is dedicated to support Customer Services activities related to theAirframe Services...

  • Data Developer

    3 days ago


    Bangalore City, India Airbus Full time

    Description: You will join the Airbus (DCS) organization in charge of the BigData Developments & Support. The mission ofthe PSL is to deliver innovative IT solutions that support digital transformation and efficient operations for customer services. More precisely the PSL is dedicated to support Customer Services activities related to the Airframe Services...

  • Data Developer

    6 days ago


    bangalore, India Airbus Full time

    Description: You will join the Airbus (DCS) organization in charge of the BigData Developments & Support. The mission of the PSL is to deliver innovative IT solutions that support digital transformation and efficient operations for customer services. More precisely the PSL is dedicated to support Customer Services activities related to the Airframe Services...


  • bangalore, India Tiger Analytics Full time

    Big Data Platform Engineer/Platform Architect Chennai, Bangalore, Hyderabad JOB DESCRIPTION Position Overview: Tiger Analytics is seeking a highly skilled and experienced Cloud and Big Data Platform Architect to join our team. The candidate will be responsible for designing, implementing, and optimizing data and analytics solutions with a strong emphasis...


  • bangalore, India JPMorgan Chase & Co. Full time

    We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.  As a Software Engineer III - Big Data/Java/Scala at JPMorgan Chase within the Liquidity Risk (LRI) team, you will be a key member of an agile team, responsible for designing and delivering trusted, market-leading technology products in a...

  • Big Data Architect

    2 months ago


    bangalore, India I Square Soft Full time

    Big Data Architect Job Description Candidate is responsible for guiding the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, technical architecture design, Infra design and build, testing, and deployment This position requires building the Bigdata/Hadoop/NoSQL DB capability in Infrastructure services under...

  • Big Data Architect

    3 weeks ago


    bangalore, India I Square Soft Full time

    Big Data Architect Job Description Candidate is responsible for guiding the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, technical architecture design, Infra design and build, testing, and deployment This position requires building the Bigdata/Hadoop/NoSQL DB capability in Infrastructure services under...

  • Engineering Manager

    2 months ago


    bangalore, India Sony Pictures Networks India Private Limited Full time

    Position: Engineering Manager – BigData, Digital Business Purpose: This position is required to provide technology leadership on medium to large scale products/platform with internal and direct customer impact. Education: ./, MCA or Equivalent Computer Degree Purpose:   The incumbent will direct the development and implementation of...

  • Engineering Manager

    3 weeks ago


    bangalore, India Sony Pictures Networks India Private Limited Full time

    Position: Engineering Manager – BigData, Digital Business Purpose: This position is required to provide technology leadership on medium to large scale products/platform with internal and direct customer impact. Education: ./, MCA or Equivalent Computer Degree Purpose:   The incumbent will direct the development and implementation of...


  • bangalore, India Impetus Full time

    We are looking to Hire Passionate professionals for Solution Architect roles with Good hands-on experience in Bigdata (Spark, and Hadoop echo system components) and Cloud (AWS/Azure/GCP).Someone who has experience in handling Cloud Migration/Modernization projects with experience in Pre-Sales Activities (preparing Proposal/SOW, RFI, RFP).Job Description10-15...

  • Big Data Developer

    3 weeks ago


    bangalore, India Fractal Full time

    Fractal analytics is looking for a Bigdata developer, please find the job description below:Experience - 5+ yearsSkills : Bigdata, Hadoop, Hive, Impala, Cloudera (Cloudera current experience is mandatory)Location - Bangalore (work from office)Notice period - 30-45 daysRESPONSIBILITIES:Our Big Data capability team needs hands-on developers who can produce...

  • Big Data Developer

    12 hours ago


    bangalore, India IBCScorp Full time

    Hi, We are hiring for Bigdata Developer for one of our Prestigious Client @ Bangalore Location. Job Location: Bangalore Position: Big Data Developer Experience: 5+yrs Total YOE: 5+ Years Technical Experience 2+ Years of experience with Big Query SQL. 4+ years of experience with Scala and SPARK. Very strong in SQL 4+ yrs Experience with GCP Cloud....

  • BigData Engineer

    2 months ago


    bangalore, India Grid Dynamics Full time

    Experience- 4-8 Years Location- Bangalore Notice- Less than 15 days Job Description: Must Have: (All or expertise in few). basic data structure, algorithms, and problem-solving knowledge Java programming, Spring Framework, and Spring Boot Functional programming: Scala/Python Big data: Hadoop (Spark and Hive) Any RDBMS (preferably MySQL) Hands-on...

  • BigData Engineer

    2 months ago


    bangalore, India Grid Dynamics Full time

    Experience- 4-8 YearsLocation- BangaloreNotice- Less than 15 daysJob Description:Must Have: (All or expertise in few).basic data structure, algorithms, and problem-solving knowledgeJava programming, Spring Framework, and Spring BootFunctional programming: Scala/PythonBig data: Hadoop (Spark and Hive)Any RDBMS (preferably MySQL)Hands-on multithreading and...

  • Data Developer

    3 weeks ago


    bangalore, India airbus Full time

    Job Description: You will join the Airbus (DCS) organization in charge of the BigData Developpements & Support. The mission of the PSL is to deliver innovative IT solutions that support digital transformation and efficient operations for customer services. More precisely the PSL is dedicated to support Customer Services activities related to the Airframe...

  • Data Developer

    1 month ago


    bangalore, India airbus Full time

    Job Description: You will join the Airbus (DCS) organization in charge of the BigData Developpements & Support. The mission of the PSL is to deliver innovative IT solutions that support digital transformation and efficient operations for customer services. More precisely the PSL is dedicated to support Customer Services activities related to the Airframe...

  • ETL Tester

    2 months ago


    bangalore, India Virtusa Full time

    ETL Tester - CREQ183871 Description Bigdata and Data Warehouse ETL Tool (Abinitio BRE & GDE) Hive query & SQL Programming (Python or Java ) from both ETL & Automation perspective Selenium Cucumber BDD Framework API Automation(Rest Assured, Robot Framework etc) Unix Shell scripting CI/CD (Bamboo, Team city, Jenkins, etc) ...


  • bangalore, India Anicalls (Pty) Ltd Full time

    Candidate should have:• Excellent interpersonal skills; strong desire to move projects forward and be proactive. Seeks opportunities to learn and improve• Strong communication skills and Good knowledge of query optimization and performance tuning.• Strong understanding of Bigdata technologies like HIVE, HBASE, HDFS, and any cloud storage like Blob...