Big Data

3 months ago

Kollam, India Myananta Technologies Full time

At Myananta Technologies, we’re looking for a Big Data (Hadoop). The ideal candidate is excited by experimentation and looking for a new challenge that stretches their talents. 


Job description


Full-Time Big Data (Hadoop) Developer

Myananta Technologies | Gurugram is hiring for “Big Data (Hadoop) Developer”


Experience: 3 - 5 Years.

Salary: 5.0 - 12.0 LPA.

Skills: Hadoop, Hive, Spark, Airflow, Python, Java, Scala, Data warehouse, Data lake.

Location: Gurgaon.


Responsibilities


  • Installation and configuration of Big Data Technologies/Tools (such as Hadoop, Hive, Spark, Data Lake,.. etc.).
  • Extensive experience in Big Data ecosystem and its various components such as Hadoop, MapReduce, Spark, Spark SLQ, Hive, ZooKeeper, Airflow.
  • Knowledge on Hadoop architectural components like HDFS distributed file system, Name Node, Data Node, Task Tracker, Job Tracker, and MapReduce programming.
  • Good knowledge of workflow orchestration tools, such as Apache Airflow design and deploy Directed Acyclic Graphs (DAGs).
  • Worked on Spark core transformation and actions along with RDD and Dataset API.
  • Knowledge of slowly changing dimensions on Hive Data warehouse.
  • Experience in deploying Big Data clusters on AWS EC2 instances and other similar clouds.
  • Develop and implement pipelines that extract, transform, and load data into an information product that helps the organization reach its strategic goals.
  • Focus on ingesting, storing, processing, and analyzing large datasets.
  • Create scalable, high-performance web services for tracking data.
  • Translate complex technical and functional requirements into detailed designs.
  • Investigate alternatives for data storing and processing to ensure implementation of the most streamlined solutions.
  • Produce scalable, flexible, efficient, and supportable solutions using appropriate technologies.
  • Analyze source and target system data. Map the transformation that meets the requirement.
  • Conduct performance and scalability tuning.


Qualifications


  • Bachelor’s/Master’s degree in Computer Science or IT (or equivalent experience).
  • Experience with Hadoop, Spark, Hive, and Airflow.
  • Understanding of data-warehousing and data-modeling techniques.
  • Knowledge of industry-wide visualization and analytics tools.
  • Strong data engineering skills with AWS cloud platform (and similar clouds).
  • Knowledge of streaming frameworks such as Kafka or Spark streaming.
  • Knowledge of Core Java, Scala, and Python (mandatory) language. 
  • Knowledge of Linux, SQL, and any scripting language.
  • Good interpersonal skills and positive attitude.

  • Big Data Engineer

    1 month ago

    kollam, India Pert Telecom Solutions Full time

    Job Description: We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for...

  • Technical Architect

    6 days ago

    Kollam, India Publicis Re:Sources Full time

    Publicis Re:Sources is hiring for Technical Manager - Architect (expertise in solution design and software architecture, particularly with Python and cloud-based technologiesExperience: 11-17 YearsLocation: Gurgaon/Bangalore/PuneWork Mode: HybridWe are looking for Immediate joiners/Max 30 days of notice.Job Description:We are seeking a self-driven and highly...

  • Regional Database Administrator

    3 weeks ago

    Kollam, India Linfox Asia Full time

    We are a leading logistics company committed to leveraging data to drive efficiency and innovation in our operations. We are seeking an experienced Data Manager who is adept in managing databases, leading a team of Data Engineers, BI, and Data Integration resources. The ideal candidate will have extensive experience with Azure SQL, MS SQL, Oracle, and...

  • Senior Dotnet Developer

    4 months ago

    Kollam, India Aventra Group Full time

    Job descriptionJob description Role: Senior .Net Full-stack Developer About Aventra: Aventra is a global IT consulting and IT services company with leading capabilities in digital transformation, cloud & Big data. It is fast paced growing scale up company having offices in Singapore, Malaysia, India, and Middle-East.Work Location: Kuala Lumpur, Malaysia Work...

  • Content and Community Associate

    4 weeks ago

    Kollam, India FRND Full time

    Overview:We are seeking a dynamic and motivated Content and Community Associate - Malayalam to join our team. The ideal candidate will be responsible for building and maintaining strong relationships with users, understanding their needs, and providing tailored solutions to enhance customer satisfaction. This role requires exceptional communication skills...

  • Senior Identity Engineer- Sailpoint IDNOW

    4 months ago

    Kollam, India Simeio Full time

    Join Our Team as a Sailpoint IDNow Support Engineer!Simeio is looking for a versatile professional to fill our Sailpoint IDNow Support Engineer role. You'll play a pivotal part in supporting our cutting-edge identity management solutions, with an exciting opportunity to contribute to development work alongside providing essential support for our prestigious...

  • Pantheon Development | Social Media Marketing Specialist

    5 days ago

    kollam, India Pantheon Development Full time

    Who We ArePantheon Development is not just a real estate company; we’re a lifestyle brand redefining affordable luxury. We’re looking for a Social Media Superstar to manage our digital stage, craft scroll-stopping content and keep audiences coming back for more and ready to relocate in Dubai, UAE. If you’re the one who speaks fluent Instagram, trends...