Big Data Developer

3 weeks ago

Bengaluru, India Unison Consulting Pte Ltd Full time

Job Description:

Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and unstructured data using cutting-edge technologies and platforms.

Responsibilities:

  • Design, develop, and maintain big data solutions using technologies such as Hadoop, HDFS, Spark, and Hive.
  • Ingest, process, and analyze large volumes of structured and unstructured data from diverse sources.
  • Develop and optimize ETL processes for efficient data extraction, transformation, and loading.
  • Implement data models, schemas, and data governance frameworks to ensure data quality and integrity.
  • Perform data exploration, profiling, and validation to identify patterns, trends, and anomalies.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights.
  • Implement and optimize data storage and retrieval strategies, including data partitioning and indexing.
  • Build and maintain scalable data pipelines and workflows for data processing.
  • Perform performance tuning and optimization of big data applications and queries.
  • Implement and maintain data security measures to protect sensitive information.
  • Maintain technical documentation of big data solutions, processes, and procedures.

Requirements

Skills and Qualifications:

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Big Data Developer with proficiency in technologies such as Hadoop, Spark, HDFS and Hive.
  • Strong programming skills in languages such as Java, Scala, or Python.
  • Experience with ETL tools and processes for data extraction, transformation, and loading.
  • Good understanding of big data concepts, architectures, and technologies.
  • Experience with SQL and NoSQL databases.
  • Knowledge of data modeling and schema design.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills to work effectively with cross-functional teams.
  • Understanding of data security and privacy principles.
  • Ability to adapt to new technologies and learn quickly in a fast-paced environment.

  • Big Data Developer

    3 weeks ago

    Bengaluru, India Aptus Data Labs Full time

    Job Title: Big Data DevelopersExperience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills ( Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem includingHDFS, Hive, and HSQLExtensive experience withPython and PySparkfor data processing and...

  • Big Data Developer

    3 weeks ago

    Greater Bengaluru Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 years Location: Remote / core location - Bangalore Mandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation ) Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQL Extensive experience with Python and PySpark for data processing and...

  • Big Data Developer

    3 weeks ago

    Greater Bengaluru Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQLExtensive experience with Python and PySpark for data processing and...

  • Big Data Developer

    2 weeks ago

    Bengaluru, India Unison Consulting Pte Ltd Full time

    Job Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big Data Developer

    2 weeks ago

    Bengaluru, India Virtusa Full time

    Big Data Developer - CREQ181026 Description Lead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production MetrologyLead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production MetrologyPrimary Location Bangalore, Karnataka, India Job Type...

  • Big Data Developer

    3 weeks ago

    Bengaluru, India Virtusa Full time

    Big Data Developer - CREQ181026 Description Lead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production Metrology Lead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production Metrology Primary Location Bangalore, Karnataka,...

  • Big Data Developer

    2 weeks ago

    Bengaluru, India BigShyft Full time

    JobDescription:We are seeking askilled and experienced Big Data Developer/Data Engineer to joinour clients team in Bengaluru. The ideal candidate should have astrong background in Java Spark Hadoop and Scala with 47 years ofrelevant workexperience.Responsibilities:Designdevelop and maintain largescale data processing systems leveragingHadoop Spark and other...

  • Big data developer

    3 weeks ago

    Bengaluru, India Virtusa Full time

    Big data developer - CREQ185815 Description Position: Big data developer Primary skills: Hadoop, hive, spark, aws Location: BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like...

  • Big data developer

    2 weeks ago

    Bengaluru, India Virtusa Full time

    Big data developer - CREQ185815 DescriptionPosition: Big data developerPrimary skills: Hadoop, hive, spark, awsLocation: BLRExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka....

  • Big Data Developer

    3 weeks ago

    Bengaluru, India Grid Dynamics Full time

    Java Big Data EngineerWe are seeking a strong Java Big Data Engineer with good technical expertise, to be responsible for the quality of a highly scalable and distributed platform.Objectives of this roleDevelop and implement pipelines that extract, transform, and load data into an information product that helps the organization reach its strategic...

  • Big Data Developer

    3 weeks ago

    Bengaluru, India Grid Dynamics Full time

    Java Big Data EngineerWe are seeking a strong Java Big Data Engineer with good technical expertise, to be responsible for the quality of a highly scalable and distributed platform.Objectives of this roleDevelop and implement pipelines that extract, transform, and load data into an information product that helps the organization reach its strategic...

  • Big Data Developer

    3 weeks ago

    Bengaluru, India Grid Dynamics Full time

    Java Big Data Engineer We are seeking a strong Java Big Data Engineer with good technical expertise, to be responsible for the quality of a highly scalable and distributed platform. Objectives of this role Develop and implement pipelines that extract, transform, and load data into an information product that helps the organization reach its strategic...

  • Big Data Developer

    3 weeks ago

    Bengaluru, India Grid Dynamics Full time

    Java Big Data EngineerWe are seeking a strong Java Big Data Engineer with good technical expertise, to be responsible for the quality of a highly scalable and distributed platform. Objectives of this roleDevelop and implement pipelines that extract, transform, and load data into an information product that helps the organization reach its strategic...

  • Big Data Developer

    3 weeks ago

    Bengaluru, India Grid Dynamics Full time

    Java Big Data EngineerWe are seeking a strong Java Big Data Engineer with good technical expertise, to be responsible for the quality of a highly scalable and distributed platform. Objectives of this roleDevelop and implement pipelines that extract, transform, and load data into an information product that helps the organization reach its strategic...

  • Big Data Developer

    3 weeks ago

    Bengaluru, India Tavant Full time

    With 24+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Fintech, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and...

  • Big Data Architect

    2 weeks ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign and architect Big Data solutions to meet business requirements.Collaborate with stakeholders to understand their data and analytics needs.Create and maintain data models, data flow diagrams, and data integration strategies.Develop and implement data ingestion, processing, and storage solutions using Big Data technologies.Optimize data...

  • Big Data Developer

    3 weeks ago

    Bengaluru, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Developer

    6 days ago

    Bengaluru, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Architect

    7 days ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd. Full time

    ResponsibilitiesDesign and architect Big Data solutions to meet business requirementsCollaborate with stakeholders to understand their data and analytics needsCreate and maintain data models, data flow diagrams, and data integration strategiesDevelop and implement data ingestion, processing, and storage solutions using Big Data technologiesOptimize data...

  • Big Data Architect

    3 weeks ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. Optimize...