Big Data Developer

1 month ago


Bengaluru, India Amossys Consulting Services Full time
Position Title: Data Engineer

Experience Required:

5+ yearsEmployment Type:

Full-timeEmployment Mode:

HybridLocation:

Bangalore, Pune, Trivandrum.Industry:

Banking & Insurance sector

Job Summary:We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong expertise in building data pipelines, working with big data technologies like Apache Hive and Parquet, and handling diverse data use cases. You will work closely with data architects and analysts to ensure the accurate, efficient, and scalable processing of data.

Key Responsibilities:Develop, optimize, and maintain scalable data pipelines using PySpark and other Big Data technologies.Work with cloud-native services to ingest, process, and store large datasets.Implement data processing solutions using Apache Hive, Parquet, and other big data storage formats.Build end-to-end data pipelines for various use cases including reporting, system integration, and API endpoints.Ensure data quality by applying data engineering best practices, testing, and validation methodologies.Collaborate with stakeholders to understand data requirements and develop solutions for effective data management.Analyse data using SQL to uncover insights and ensure efficient querying and reporting.Maintain an understanding of data modelling principles and apply them to consumption scenarios.

Qualifications:Bachelor’s degree in computers science, Engineering, or related field.Min 5 years of experience in data engineering, with proven skills in PySpark and Big Data platforms.Proficiency in Apache Hive, Parquet, and other Big Data technologies.Experience with at least two end-to-end Big Data projects involving the ingestion, processing, and storage of data.Knowledge of cloud-native services, with at least one project experience.Solid data analysis skills using SQL.Understanding of data modelling concepts.Azure Synapse knowledge is desirable.


  • Big Data Developer

    1 month ago


    Bengaluru, Karnataka, India Unison Consulting Pte Ltd Full time

    Job Title: Big Data DeveloperUnison Consulting Pte Ltd is seeking an experienced Big Data Developer to design, develop, and maintain big data solutions to enable data-driven decision making and analytics capabilities for our clients. As a Big Data Developer, you will work with large volumes of structured and unstructured data using cutting-edge technologies...

  • Big Data Developer

    8 months ago


    Bengaluru, India Unison Consulting Pte Ltd Full time

    Job Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big Data Developer

    4 weeks ago


    Bengaluru, Karnataka, India IBCScorp Full time

    Job Title: Big Data Developer About the Role: We are seeking a skilled Big Data Developer to join our team at IBCScorp. As a Big Data Developer, you will be responsible for designing, developing, and implementing data-driven solutions using Hadoop, Spark, and NoSQL databases. Key Responsibilities:Develop and maintain large-scale data processing systems...

  • Big Data Developer

    2 weeks ago


    Bengaluru, India Advent Global Solutions Full time

    Position : Big Data Developer/Big Data Senior DeveloperLocation : Chennai, Bangalore, Pune, Gurgaon, and MumbaiExperience : 5 to 14 yearsRelevant : should be 4+ yrs for Junior and 7+ yrs for SeniorPrimary skills : Spark, SQL,HiveDevelop and maintain architectures such as databases and large-scale processing systems using Python, Scala, SQL, and Unix...

  • Big data developer

    4 weeks ago


    Bengaluru, India Amossys Consulting Services Full time

    Position Title: Data EngineerExperience Required: 5+ yearsEmployment Type: Full-timeEmployment Mode: HybridLocation: Bangalore, Pune, Trivandrum.Industry: Banking & Insurance sectorJob Summary:We are looking for a skilled Data Engineer with hands-on experience in Py Spark and Big Data platforms to join our growing team. The ideal candidate will have...

  • Big Data Developer

    4 weeks ago


    Bengaluru, Karnataka, India Globalemployees Full time

    About the Role:We are seeking a highly skilled Data Scientist with expertise in Big Data to join our team at Globalemployers.Key Responsibilities:Develop, test, and deploy big data applications and pipelines.Work with Hadoop, Spark, Kafka, and related big data technologies.Optimize data workflows for performance, scalability, and efficiency.Collaborate with...

  • Big Data Developer

    2 weeks ago


    Bengaluru, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: Bangalore/Chennai/Hyderabad/PuneExperience:5-10 Years- Required Technical skills: Bigdata, Hadoop Technologies- 4+ years of experience in Big Data,...

  • Big data developer

    2 weeks ago


    Bengaluru, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: Bangalore/Chennai/Hyderabad/PuneExperience:5-10 YearsRequired Technical skills: Bigdata, Hadoop Technologies4+ years of experience in Big Data,...

  • Big Data Developer

    2 months ago


    Bengaluru, India HARMAN India Full time

    Harman India is looking for Big Data Developer.Location: Bangalore Experience: 4-6Years.Notice Period: Immediate to 15Days.Skill Set required: 1. Design, develop, and implement highly scalable and distributed big data solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and Spark. 2. Architect HBase schemas and data models to accommodate...

  • Big Data Developer

    2 months ago


    Bengaluru, India HARMAN India Full time

    Harman India is looking for Big Data Developer.Location: Bangalore Experience: 4-6Years.Notice Period: Immediate to 15Days.Skill Set required: 1. Design, develop, and implement highly scalable and distributed big data solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and Spark. 2. Architect HBase schemas and data models to accommodate...

  • Big Data Developer

    1 week ago


    Bengaluru, India LTIMindtree Full time

    Please fill this form for quick responses ;-If it is not able to access please past it on Google and try to fill it...Link:- Big Data Developer/ Big Data EngineerSkills:- Pyspark, Sql, Hive,Exp:- 5 + YearsLoc:- Bengaluru, NCR Noida, Gurugram, DelhiMode;- HybridRegards,Dhamodhar. GTA

  • Big data developer

    6 days ago


    Bengaluru, India LTIMindtree Full time

    Please fill this form for quick responses ;-If it is not able to access please past it on Google and try to fill it...Link:- Lx Fw Yq9Role:- Big Data Developer/ Big Data EngineerSkills:- Pyspark, Sql, Hive,Exp:- 5 + YearsLoc:- Bengaluru, NCR Noida, Gurugram, DelhiMode;- HybridRegards,Dhamodhar. GTA

  • Big Data Developer

    3 weeks ago


    Bengaluru, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: Bangalore/Chennai/Hyderabad/PuneExperience:5-10 YearsRequired Technical skills: Bigdata, Hadoop Technologies4+ years of experience in Big Data,...

  • Big Data Developer

    1 week ago


    Greater Bengaluru Area, India Pixomania Full time

    Job Title: Big Data Developer (Scala + Spark)Location: RemoteExperience: 5+ yearsJob Type: Contractual RemoteAbout Us:We are a forward-thinking technology company committed to delivering innovative solutions in Big Data analytics. Join our talented team as a Big Data Developer with expertise in Scala and Apache Spark to drive impactful projects and...

  • Big Data Developer

    1 week ago


    Greater Bengaluru Area, India Pixomania Full time

    Job Title: Big Data Developer (Scala + Spark)Location: RemoteExperience: 5+ yearsJob Type: Contractual RemoteAbout Us:We are a forward-thinking technology company committed to delivering innovative solutions in Big Data analytics. Join our talented team as a Big Data Developer with expertise in Scala and Apache Spark to drive impactful projects and...

  • Big Data Developer

    4 months ago


    Bengaluru, India IBCScorp Full time

    Hi,We are hiring for Bigdata Developer for one of our Prestigious Client @ Bangalore Location. Job Location: BangalorePosition: Big Data DeveloperExperience: 5+yrsTotal YOE: 5+ Years Technical Experience 2+ Years of experience with Big Query SQL. 4+ years of experience with Scala and SPARK. Very strong in SQL 4+ yrs Experience with GCP Cloud. Candidate...

  • Big Data Developer

    3 weeks ago


    Bengaluru, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: Bangalore/Chennai/Hyderabad/PuneExperience:5-10 YearsRequired Technical skills: Bigdata, Hadoop Technologies4+ years of experience in Big Data,...

  • BIG DATA Developer

    1 month ago


    Bengaluru, India IBCScorp Full time

    Please see below the JD for Bigdata developer:Candidate should be available to interview in person in BangaloreWorking within a cross functional, agile development team, this Big Data Developer will be responsible for hands on development and technical delivery of innovative components used in data driven solutions.The candidate will have a sound working...

  • Big Data Developer

    1 week ago


    Bengaluru, India LTIMindtree Full time

    Please fill this form for quick responses ;- If it is not able to access please past it on Google and try to fill it... Link:- Role:- Big Data Developer/ Big Data Engineer Skills:- Pyspark, Sql, Hive, Exp:- 5 + Years Loc:- Bengaluru, NCR Noida, Gurugram, Delhi Mode;- Hybrid Regards, Dhamodhar. G TA


  • Bengaluru, Karnataka, India Mobileum Full time

    About the RoleWe are seeking a talented Big Data Development Manager to lead our team of platform engineers and Big Data engineers in building and enhancing best-in-class data analytics platforms and solutions.This role requires a strong technical background, with expertise in Big Data technologies, distributed computing, and scalable fault-tolerant platform...