Big Data

2 months ago

Gurgaon, India Myananta Technologies Full time
At Myananta Technologies, we’re looking for a Big Data (Hadoop). The ideal candidate is excited by experimentation and looking for a new challenge that stretches their talents.
Job description
Full-Time Big Data (Hadoop) Developer
Myananta Technologies | Gurugram is hiring for “Big Data (Hadoop) Developer”
Experience : 3 - 5 Years.
Salary : 5.0 - 12.0 LPA.
Skills : Hadoop, Hive, Spark, Airflow, Python, Java, Scala, Data warehouse, Data lake.
Location : Gurgaon.
Responsibilities
Installation and configuration of Big Data Technologies/Tools (such as Hadoop, Hive, Spark, Data Lake,.. etc.).
Extensive experience in Big Data ecosystem and its various components such as Hadoop, MapReduce, Spark, Spark SLQ, Hive, ZooKeeper, Airflow.
Knowledge on Hadoop architectural components like HDFS distributed file system, Name Node, Data Node, Task Tracker, Job Tracker, and MapReduce programming.
Good knowledge of workflow orchestration tools, such as Apache Airflow design and deploy Directed Acyclic Graphs (DAGs).
Worked on Spark core transformation and actions along with RDD and Dataset API.
Knowledge of slowly changing dimensions on Hive Data warehouse.
Experience in deploying Big Data clusters on AWS EC2 instances and other similar clouds.
Develop and implement pipelines that extract, transform, and load data into an information product that helps the organization reach its strategic goals.
Focus on ingesting, storing, processing, and analyzing large datasets.
Create scalable, high-performance web services for tracking data.
Translate complex technical and functional requirements into detailed designs.
Investigate alternatives for data storing and processing to ensure implementation of the most streamlined solutions.
Produce scalable, flexible, efficient, and supportable solutions using appropriate technologies.
Analyze source and target system data. Map the transformation that meets the requirement.
Conduct performance and scalability tuning.
Qualifications
Bachelor’s/Master’s degree in Computer Science or IT (or equivalent experience).
Experience with Hadoop, Spark, Hive, and Airflow.
Understanding of data-warehousing and data-modeling techniques.
Knowledge of industry-wide visualization and analytics tools.
Strong data engineering skills with AWS cloud platform (and similar clouds).
Knowledge of streaming frameworks such as Kafka or Spark streaming.
Knowledge of Core Java, Scala, and Python (mandatory) language.
Knowledge of Linux, SQL, and any scripting language.
Good interpersonal skills and positive attitude.

  • Big Data Developer

    4 weeks ago

    Gurgaon, Haryana, India Smart Consulting - Creating Future Leaders Full time

    Job Title: Big Data DeveloperSmart Consulting - Creating Future Leaders is seeking a highly skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, building, and maintaining data ingestion and transformation processes using Java, Spark, and other Big Data technologies.Responsibilities:Develop robust and...

  • Big Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India Impetus Full time

    Job Title: Big Data DeveloperAt Impetus, we are seeking a highly skilled Big Data Developer to join our team. The ideal candidate will have a strong background in designing and coding across multiple platforms and languages, with expertise in Big Data technologies.Key Responsibilities:Design, develop, test, and deploy efficient and maintainable systems using...

  • Big Data Developer

    4 weeks ago

    Gurgaon, Haryana, India Spectral Consultants Full time

    About the RoleSpectral Consultants is seeking a highly skilled Big Data Developer to join our team. As a key member of our data science team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data technologies.Key ResponsibilitiesDesign and develop data processing pipelines using Big Data...

  • Big Data Developer

    4 weeks ago

    Gurgaon, Haryana, India Myananta Technologies Full time

    Job Title: Big Data DeveloperWe are seeking a highly skilled Big Data Developer to join our team at Myananta Technologies. As a Big Data Developer, you will be responsible for designing, developing, and implementing large-scale data processing systems using Hadoop and related technologies.Key Responsibilities:Design and develop data processing pipelines...

  • Big Data Architect

    5 months ago

    Gurgaon, India Techfrolic Software Solutions Pvt. Ltd Full time

    **Job description** We are seeking a highly skilled and experienced Big Data Architect to join our team. As a Big Data Architect, you will be responsible for designing and implementing robust, scalable, and high-performance big data solutions that meet our client's diverse and complex requirements. Your expertise in big data technologies, data modeling, and...

  • Big Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India PRONTO CONSULTING SERVICES Full time

    Job Title: Big Data DeveloperJob Summary:We are seeking a highly skilled Big Data Developer to join our team at Pronto Consulting Services. As a Big Data Developer, you will be responsible for designing and developing data engineering solutions on big data ecosystems, developing custom applications, and modifying existing applications to meet distinct and...

  • Big Data Architect

    4 weeks ago

    Gurgaon, Haryana, India Absolutdata Full time

    About the RoleAbsolutdata is revolutionizing the way companies make decisions with our cutting-edge Big Data solutions. As a Technical Lead/Senior Technical Lead - Big Data, you will be at the forefront of this revolution, building and implementing optimal Big Data Infrastructure solutions that drive business results.Key ResponsibilitiesDesign and develop...

  • Big Data Developer

    3 weeks ago

    Gurgaon, Haryana, India Spectral Consultants Full time

    Job Title: Big Data DeveloperJob Summary:We are seeking a highly skilled Big Data Developer to join our team at Spectral Consultants. As a Big Data Developer, you will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and Hive.Key Responsibilities:* Design and...

  • Big Data Developer

    4 weeks ago

    Gurgaon, Haryana, India Myananta Technologies Full time

    Job Title: Big Data DeveloperWe are seeking a highly skilled Big Data Developer to join our team at Myananta Technologies. As a Big Data Developer, you will be responsible for designing, developing, and deploying large-scale data processing systems using Hadoop and related technologies.Responsibilities:Design and develop scalable data processing systems...

  • Big Data Developer

    2 weeks ago

    Gurgaon, Haryana, India Spectral Consultants Full time

    Job SummarySpectral Consultants is seeking a skilled Big Data Developer to join our team. As a key member of our data analytics team, you will be responsible for designing, developing, and implementing data-driven solutions using big data technologies.Key ResponsibilitiesDevelop and maintain large-scale big data systems using programming languages such as...

  • Big Data Developer

    3 weeks ago

    Gurgaon, Haryana, India Spectral Consultants Full time

    Job SummarySpectral Consultants is seeking a highly skilled Big Data Developer to join our team. As a key member of our data science team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and Hive.Key ResponsibilitiesDesign and develop complex data...

  • Big Data Developer

    4 weeks ago

    Gurgaon, Haryana, India Spectral Consultants Full time

    Job Title: Big Data DeveloperAbout the RoleSpectral Consultants is seeking a highly skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and Hive.Key ResponsibilitiesApply agile and...

  • Big Data Specialist

    6 days ago

    Gurgaon, Haryana, India Spectral Consultants Full time

    Job DescriptionAt Spectral Consultants, we are seeking a talented Big Data Developer to join our team. The ideal candidate will have a strong background in big data fundamentals, including Hive, Spark, Hadoop, and MapReduce.In this role, you will be responsible for building complex solutions using programming languages, big data service platforms, and other...

  • Big Data Consultant

    2 weeks ago

    Gurgaon, Haryana, India IQuest Management Consultants Full time

    **Job Description:**A passionate Big Data Consultant with hands-on Spark/Scala programming experience is required to participate in agile development projects for batch and real-time data ingestion. The ideal candidate will integrate with AWS, Real-Time Systems, Data Warehouses, and Analytics solutions.**Key Responsibilities:**Hands-on Spark/Scala...

  • Big Data Developer

    4 weeks ago

    Gurgaon, Haryana, India Impetus Full time

    Job DescriptionImpetus is seeking a highly skilled Big Data Developer to join our team.As a Big Data Developer, you will be responsible for designing, developing, and deploying large-scale data processing systems using various technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Collaborate with cross-functional teams to deliver...

  • Big Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India dunnhumby Full time

    We're seeking a talented Big Data Engineerto extend and improve our Data Engineering Team. This is an opportunity to work with a market-leading business to explore new opportunities for us and influence global retailers.About the RoleAs a Big Data Engineer, you will be responsible for working with stakeholders in the development of data technology that meet...

  • Big Data Developer

    4 weeks ago

    Gurgaon, Haryana, India Spectral Consultants Full time

    Job Title: Big Data DeveloperSpectral Consultants is seeking a highly skilled Big Data Developer to join our team. As a key member of our data science team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Big Data technologies.Key Responsibilities:Apply agile and waterfall development...

  • Big Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full time

    Job Title: Big Data DeveloperJob Summary:We are seeking an experienced Big Data Developer to join our team at Spectral Consultants. The ideal candidate will have a strong background in building scalable and efficient data pipelines using Hive, Spark, Hadoop, and MapReduce.Key Responsibilities:Design, implement, and optimize large-scale data processing...

  • Big Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Impetus Full time

    About the RoleWe are seeking a skilled Big Data Developer to join our team at Impetus. The ideal candidate will have experience with design and coding across multiple platforms and languages, including Python, Pyspark, and Scala.Key ResponsibilitiesDesign, develop, test, and deploy efficient and maintainable systems using Big Data technologies.Collaborate...

  • Big Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full time

    Job Title: Big Data DeveloperJob Summary:We are seeking an experienced Big Data Developer to join our team at Spectral Consultants. The ideal candidate will have a strong background in building scalable and efficient data pipelines using Hive, Spark, Hadoop, and MapReduce.Key Responsibilities:Design, implement, and optimize large-scale data processing...