Big Data Developer

1 month ago

bangalore, India Unison Consulting Pte Ltd Full time

Job Description:

Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and unstructured data using cutting-edge technologies and platforms.

Responsibilities:

  • Design, develop, and maintain big data solutions using technologies such as Hadoop, HDFS, Spark, and Hive.
  • Ingest, process, and analyze large volumes of structured and unstructured data from diverse sources.
  • Develop and optimize ETL processes for efficient data extraction, transformation, and loading.
  • Implement data models, schemas, and data governance frameworks to ensure data quality and integrity.
  • Perform data exploration, profiling, and validation to identify patterns, trends, and anomalies.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights.
  • Implement and optimize data storage and retrieval strategies, including data partitioning and indexing.
  • Build and maintain scalable data pipelines and workflows for data processing.
  • Perform performance tuning and optimization of big data applications and queries.
  • Implement and maintain data security measures to protect sensitive information.
  • Maintain technical documentation of big data solutions, processes, and procedures.

Requirements

Skills and Qualifications:

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Big Data Developer with proficiency in technologies such as Hadoop, Spark, HDFS and Hive.
  • Strong programming skills in languages such as Java, Scala, or Python.
  • Experience with ETL tools and processes for data extraction, transformation, and loading.
  • Good understanding of big data concepts, architectures, and technologies.
  • Experience with SQL and NoSQL databases.
  • Knowledge of data modeling and schema design.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills to work effectively with cross-functional teams.
  • Understanding of data security and privacy principles.
  • Ability to adapt to new technologies and learn quickly in a fast-paced environment.

  • Big Data Developer

    3 weeks ago

    bangalore, India BigShyft Full time

    JobDescription: We are seeking askilled and experienced Big Data Developer/Data Engineer to joinour clients team in Bengaluru. The ideal candidate should have astrong background in Java Spark Hadoop and Scala with 47 years ofrelevant workexperience.Responsibilities: Designdevelop and maintain largescale data processing systems leveragingHadoop Spark and...

  • Big data developer

    1 month ago

    bangalore, India Virtusa Full time

    Big data developer - CREQ185815 Description Position: Big data developer Primary skills: Hadoop, hive, spark, aws Location: BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems...

  • Big Data Developer

    1 week ago

    bangalore, India HTC Global Services Full time

    About HTC Global ServicesHTC Global Services is a US based IT solutions and IT enabled services company with its global headquarters in Troy, MI. We are an Inc 500 Hall of Fame company with our existence in the industry for three decades. HTC is a SEI-CMM Level 5 and ISO 9001 & ISO 27001 certified organization. HTC has its global presence in North America,...

  • Big Data Developer

    1 week ago

    bangalore, India HTC Global Services Full time

    About HTC Global Services HTC Global Services is a US based IT solutions and IT enabled services company with its global headquarters in Troy, MI. We are an Inc 500 Hall of Fame company with our existence in the industry for three decades. HTC is a SEI-CMM Level 5 and ISO 9001 & ISO 27001 certified organization. HTC has its global presence in North America,...

  • Big Data Engineer

    1 day ago

    bangalore, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and...

  • Big Data Developer

    1 month ago

    bangalore, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Architect

    1 month ago

    bangalore, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. ...

  • Big Data Developer

    1 week ago

    Bangalore Urban, India HTC Global Services Full time

    About HTC Global ServicesHTC Global Services is a US based IT solutions and IT enabled services company with its global headquarters in Troy, MI. We are an Inc 500 Hall of Fame company with our existence in the industry for three decades. HTC is a SEI-CMM Level 5 and ISO 9001 & ISO 27001 certified organization. HTC has its global presence in North America,...

  • Big Data Developer

    1 month ago

    bangalore, India Nityo Infotech Full time

    •2+ or 4+ years of experience in the role of implementation of high end software products.•Sound knowledge of Kubernetes and deployment methodologies•Bigdata (Hdfs/hive/HBASE/KAFka), either of Spark/Pyspark is mandatory , with strong problem-solving skills, and able to thrive with minimal supervision.•Knowledge of database principles, SQL, and...

  • Big Data Engineer

    1 month ago

    bangalore, India Virtusa Full time

    Big Data Engineer - CREQ184231 Description Profile : 5-8 years IT experience with minimum 2 years in Spark and Big Data platform Experience in Big Data technologies Hadoop, HDFS, Hive, Yarn, Jenkins, Ansible Job DescriptionResponsibilitiesSkill: Spark, ScalaLevel: Senior Software EngineerCategory: Special/NicheTenure: 1 YearMission :He (or she) is in charge...

  • Big Data Analyst

    1 month ago

    bangalore, India Corporate Resources Full time

    Job Description  Big data analyst with knowledge of big data technologies and ability to analyze large volumes of data and bring out insights  Reporting and presenting on data insights  Handson knowledge of scripting and using Big data tools  Data analysis and processing ...

  • Big Data Developer

    2 weeks ago

    Gurgaon/Gurugram/Bangalore, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Developer

    4 weeks ago

    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big data architect

    1 month ago

    bangalore, India Virtusa Full time

    Big data architect - CREQ185795 Description Position: Big data architect Location: BLR Primary skills: Big data hadoop spark & aws Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig...

  • IQVIA - Big Data Developer - Hadoop/Spark

    1 month ago

    Bangalore, India IQVIA RDS India Pvt Ltd Full time

    Job Title / Primary Skill : Big Data Developer Management Level : G130 Years of Experience : 2 to 5 years Job Location : Bangalore (Hybrid) Must Have Skills : Bigdata Developer, Hadoop, Hive, Scala, and Spark. Educational Qualification : BE/BTech/ MTech/ MCA Role & responsibilities : - Minimum 3+ years of experience in Big Data development.- Good...

  • IQVIA - Big Data Developer - Hadoop/Spark

    4 weeks ago

    Bangalore, Karnataka, India IQVIA RDS India Pvt Ltd Full time

    Job Title / Primary Skill : Big Data DeveloperManagement Level : G130Years of Experience : 2 to 5 yearsJob Location : Bangalore (Hybrid)Must Have Skills : Bigdata Developer, Hadoop, Hive, Scala, and Spark.Educational Qualification : BE/BTech/ MTech/ MCARole & responsibilities : - Minimum 3+ years of experience in Big Data development.- Good understanding of...

  • Aws big data engineer

    1 month ago

    bangalore, India Global Pharma Tek Full time

    ob Description Technical skills . Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications...

  • Big Data Consultant

    2 weeks ago

    bangalore, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...

  • Big Data Consultant

    2 weeks ago

    Bangalore, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...

  • Big Data Consultant

    4 weeks ago

    Bangalore, Karnataka, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...