Big data developer

4 weeks ago


bangalore, India Virtusa Full time
Big data developer - CREQ185815 Description Position: Big data developer Primary skills: Hadoop, hive, spark, aws Location: BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of vast data stores. Good understanding of cloud technology. Must have strong technical experience in Design Mapping specifications HLD LLD. Must have the ability to relate to both business and technical members of the team and possess excellent communication skills. Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs.
Develop and maintain data platforms using Python
Work with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrity
Collaborate with crossfunctional teams to understand data requirements and design solutions that meet business needs
Implement and manage agents for monitoring, logging, and automation within AWS environments
Handling migration from PySpark to AWS Primary Location Bangalore, Karnataka, India Job Type Experienced Primary Skills Java, PySpark, Python Years of Experience 8 Qualification Education qualification: Any degree or equivalent Experience: 7+ years Travel No
  • Big Data Developer

    4 weeks ago


    Bangalore Metropolitan Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQLExtensive experience with Python and PySpark for data processing and...

  • Big Data Developer

    4 weeks ago


    bangalore, India Unison Consulting Pte Ltd Full time

    Job Description: Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big Data Developer

    3 weeks ago


    bangalore, India BigShyft Full time

    JobDescription: We are seeking askilled and experienced Big Data Developer/Data Engineer to joinour clients team in Bengaluru. The ideal candidate should have astrong background in Java Spark Hadoop and Scala with 47 years ofrelevant workexperience.Responsibilities: Designdevelop and maintain largescale data processing systems leveragingHadoop Spark and...

  • Big Data Developer

    7 days ago


    bangalore, India HTC Global Services Full time

    About HTC Global ServicesHTC Global Services is a US based IT solutions and IT enabled services company with its global headquarters in Troy, MI. We are an Inc 500 Hall of Fame company with our existence in the industry for three decades. HTC is a SEI-CMM Level 5 and ISO 9001 & ISO 27001 certified organization. HTC has its global presence in North America,...

  • Big Data Developer

    7 days ago


    bangalore, India HTC Global Services Full time

    About HTC Global Services HTC Global Services is a US based IT solutions and IT enabled services company with its global headquarters in Troy, MI. We are an Inc 500 Hall of Fame company with our existence in the industry for three decades. HTC is a SEI-CMM Level 5 and ISO 9001 & ISO 27001 certified organization. HTC has its global presence in North America,...

  • Big Data Developer

    4 weeks ago


    bangalore, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Architect

    4 weeks ago


    bangalore, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. ...

  • Big Data Developer

    1 week ago


    Bangalore Urban, India HTC Global Services Full time

    About HTC Global ServicesHTC Global Services is a US based IT solutions and IT enabled services company with its global headquarters in Troy, MI. We are an Inc 500 Hall of Fame company with our existence in the industry for three decades. HTC is a SEI-CMM Level 5 and ISO 9001 & ISO 27001 certified organization. HTC has its global presence in North America,...

  • Big Data Developer

    7 days ago


    bangalore, India Concentrix Full time

    Data Engineer Big DataJob DescriptionDevelops and maintains scalable data pipelinesCollaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.Implements processes and systems to monitor data quality, ensuring...

  • Big Data Developer

    7 days ago


    bangalore, India Concentrix Full time

    Data Engineer Big Data Job Description Develops and maintains scalable data pipelines Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization. Implements processes and systems to monitor data quality,...

  • Big Data Developer

    4 weeks ago


    bangalore, India Nityo Infotech Full time

    •2+ or 4+ years of experience in the role of implementation of high end software products.•Sound knowledge of Kubernetes and deployment methodologies•Bigdata (Hdfs/hive/HBASE/KAFka), either of Spark/Pyspark is mandatory , with strong problem-solving skills, and able to thrive with minimal supervision.•Knowledge of database principles, SQL, and...

  • Big Data Engineer

    4 weeks ago


    bangalore, India Virtusa Full time

    Big Data Engineer - CREQ184231 Description Profile : 5-8 years IT experience with minimum 2 years in Spark and Big Data platform Experience in Big Data technologies Hadoop, HDFS, Hive, Yarn, Jenkins, Ansible Job DescriptionResponsibilitiesSkill: Spark, ScalaLevel: Senior Software EngineerCategory: Special/NicheTenure: 1 YearMission :He (or she) is in charge...

  • Big Data Analyst

    4 weeks ago


    bangalore, India Corporate Resources Full time

    Job Description  Big data analyst with knowledge of big data technologies and ability to analyze large volumes of data and bring out insights  Reporting and presenting on data insights  Handson knowledge of scripting and using Big data tools  Data analysis and processing ...

  • Big data architect

    4 weeks ago


    bangalore, India Virtusa Full time

    Big data architect - CREQ185795 Description Position: Big data architect Location: BLR Primary skills: Big data hadoop spark & aws Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig...

  • Big Data Developer

    3 weeks ago


    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Developer

    2 weeks ago


    Gurgaon/Gurugram/Bangalore, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...


  • Bangalore, Karnataka, India IQVIA RDS India Pvt Ltd Full time

    Job Title / Primary Skill : Big Data DeveloperManagement Level : G130Years of Experience : 2 to 5 yearsJob Location : Bangalore (Hybrid)Must Have Skills : Bigdata Developer, Hadoop, Hive, Scala, and Spark.Educational Qualification : BE/BTech/ MTech/ MCARole & responsibilities : - Minimum 3+ years of experience in Big Data development.- Good understanding of...


  • Bangalore, India IQVIA RDS India Pvt Ltd Full time

    Job Title / Primary Skill : Big Data Developer Management Level : G130 Years of Experience : 2 to 5 years Job Location : Bangalore (Hybrid) Must Have Skills : Bigdata Developer, Hadoop, Hive, Scala, and Spark. Educational Qualification : BE/BTech/ MTech/ MCA Role & responsibilities : - Minimum 3+ years of experience in Big Data development.- Good...

  • Aws big data engineer

    4 weeks ago


    bangalore, India Global Pharma Tek Full time

    ob Description Technical skills . Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications...

  • Big Data Consultant

    1 week ago


    bangalore, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...