Big Data

2 months ago

Kollam, India Myananta Technologies Full time

At Myananta Technologies, we’re looking for a Big Data (Hadoop). The ideal candidate is excited by experimentation and looking for a new challenge that stretches their talents. 


Job description


Full-Time Big Data (Hadoop) Developer

Myananta Technologies | Gurugram is hiring for “Big Data (Hadoop) Developer”


Experience: 3 - 5 Years.

Salary: 5.0 - 12.0 LPA.

Skills: Hadoop, Hive, Spark, Airflow, Python, Java, Scala, Data warehouse, Data lake.

Location: Gurgaon.


Responsibilities


  • Installation and configuration of Big Data Technologies/Tools (such as Hadoop, Hive, Spark, Data Lake,.. etc.).
  • Extensive experience in Big Data ecosystem and its various components such as Hadoop, MapReduce, Spark, Spark SLQ, Hive, ZooKeeper, Airflow.
  • Knowledge on Hadoop architectural components like HDFS distributed file system, Name Node, Data Node, Task Tracker, Job Tracker, and MapReduce programming.
  • Good knowledge of workflow orchestration tools, such as Apache Airflow design and deploy Directed Acyclic Graphs (DAGs).
  • Worked on Spark core transformation and actions along with RDD and Dataset API.
  • Knowledge of slowly changing dimensions on Hive Data warehouse.
  • Experience in deploying Big Data clusters on AWS EC2 instances and other similar clouds.
  • Develop and implement pipelines that extract, transform, and load data into an information product that helps the organization reach its strategic goals.
  • Focus on ingesting, storing, processing, and analyzing large datasets.
  • Create scalable, high-performance web services for tracking data.
  • Translate complex technical and functional requirements into detailed designs.
  • Investigate alternatives for data storing and processing to ensure implementation of the most streamlined solutions.
  • Produce scalable, flexible, efficient, and supportable solutions using appropriate technologies.
  • Analyze source and target system data. Map the transformation that meets the requirement.
  • Conduct performance and scalability tuning.


Qualifications


  • Bachelor’s/Master’s degree in Computer Science or IT (or equivalent experience).
  • Experience with Hadoop, Spark, Hive, and Airflow.
  • Understanding of data-warehousing and data-modeling techniques.
  • Knowledge of industry-wide visualization and analytics tools.
  • Strong data engineering skills with AWS cloud platform (and similar clouds).
  • Knowledge of streaming frameworks such as Kafka or Spark streaming.
  • Knowledge of Core Java, Scala, and Python (mandatory) language. 
  • Knowledge of Linux, SQL, and any scripting language.
  • Good interpersonal skills and positive attitude.

  • Big Data Developer

    4 weeks ago

    kollam, India Amossys Consulting Services Full time

    Position Title: Data EngineerExperience Required: 5+ years Employment Type: Full-time Employment Mode: HybridLocation: Bangalore, Pune, Trivandrum.Industry: Banking & Insurance sectorJob Summary:We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong...

  • Big Data Developer

    1 month ago

    kollam, India Quess IT Staffing Full time

    Company Name:-Quess IT StaffingJob Title- Big Data DeveloperExperience : 4+ YearsMandatory Skills:-Pyspark, Jenkins/ Airflow , AWS or strong fundamentally AzureLocation : Bangalore ( Hybrid)Notice Period:- Immediate to 15 DaysMode of Interview- L1 virtualL2 Face to face

  • Big Data Developer

    4 weeks ago

    Kollam, India Quess IT Staffing Full time

    We are looking for candidate with 4+ years of experience in a Data Engineer role and has attained bachelor’s degree in technology and has experienced with Agile/Scrum development process and methodologies. • Experience as a Data Engineer with strong track record of designing and implementing data solutions. • Experience in programming language as...

  • Data Engineer

    4 weeks ago

    Kollam, India BytesCraft Full time

    Job Title: Data Engineer Location: Ahmedabad Experience: 3-4 yearsJob Overview:We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have hands-on experience with Azure Databricks, Azure Data Factory, Azure Data Lake Storage, and Microsoft Fabric. This role will involve designing, developing, and...

  • Data and Analytics Principal Solution Architect

    4 weeks ago

    Kollam, India INFINIMINDS Full time

    Key Responsibilities:1. Pre-Sales Responsibilities:Engage with potential clients to understand their data needs, challenges, and objectives.Lead discovery sessions, gather requirements, and develop high-level solution architectures for data and analytics initiatives.Prepare and present compelling proposals, solution demos, and proof of concepts that...

  • 数据工程师

    4 weeks ago

    Kollam, India Lamipak Full time

    Summary of Job Duties工作概要We are seeking a highly skilled Data Engineer to design, build, and maintain the data infrastructure supporting our Al platforms. You will be responsible for creating robust data pipelines, ensuring the seamless flow of structured and unstructured data between backend systems and Al models, and optimizing data storage for...

  • Power BI Developer

    4 weeks ago

    Kollam, India Technofocus Full time

    Job Overview:We are looking for a BI & Visualization Developer who will be part of our Analytics Practice and will be expected to actively work in a multi-disciplinary fast paced environment. This role requires a broad range of skills and the ability to step into different roles depending on the size and scope of the project; its primary responsibility is to...

  • Senior Software Support Engineer

    1 month ago

    Kollam, India Luxoft Full time

    Project descriptionWe are currently seeking a highly skilled and motivated individual to join our Research & Analytics IT Production Management Support team (in Middle East). The ideal candidate should possess a technical background with 5-7 years of experience in production support and be ITIL certified. It is essential for the candidate to have a solid...

  • Lead BackEnd

    4 weeks ago

    kollam, India Sberbank India Full time

    About the role:We are the development center for Sber's India branch.The Agile team consists of 100+ IT professionals with the potential to grow to 500+ in 2025.You have a unique opportunity to participate in building an Automated Banking System (ABS) for Sber's Indian branch from scratch.The system consists of a set of modules - core, accounting, reporting,...

  • Senior Identity Engineer- Sailpoint IDNOW

    1 month ago

    Kollam, India Simeio Full time

    Join Our Team as a Sailpoint IDNow Support Engineer!Simeio is looking for a versatile professional to fill our Sailpoint IDNow Support Engineer role. You'll play a pivotal part in supporting our cutting-edge identity management solutions, with an exciting opportunity to contribute to development work alongside providing essential support for our prestigious...

  • Senior Identity Engineer- Sailpoint IDNOW

    3 months ago

    Kollam, India Simeio Full time

    Join Our Team as a Sailpoint IDNow Support Engineer!Simeio is looking for a versatile professional to fill our Sailpoint IDNow Support Engineer role. You'll play a pivotal part in supporting our cutting-edge identity management solutions, with an exciting opportunity to contribute to development work alongside providing essential support for our prestigious...

  • Senior Workday Analyst

    3 weeks ago

    Kollam, India System Soft Technologies Full time

    Job Description – Senior Workday AnalystSystem Soft Technologies is a premier technology company providing exceptional consulting services and solutions that drive innovation, enhance business value, and boost competitiveness. For over 25 years, we have built trusted partnerships with our clients, helping us grow into a $200MM+ enterprise. With the...

  • Senior Workday Analyst

    4 weeks ago

    Kollam, India System Soft Technologies Full time

    Job Description – Senior Workday AnalystSystem Soft Technologies is a premier technology company providing exceptional consulting services and solutions that drive innovation, enhance business value, and boost competitiveness. For over 25 years, we have built trusted partnerships with our clients, helping us grow into a $200MM+ enterprise. With the...