Big Data Engineering

4 days ago

Noida, Uttar Pradesh, India prudentialmanp Full time ₹ 12,00,000 - ₹ 36,00,000 per year
  • Bachelor's degree in computer science, or similar technical field
  • Minimum 5 years of experience in Big Data Engineering/Data Analysis

Preferred Skills and Qualifications:

  • Proficiency in Python, SQL and Apache Spark
  • Strong Experience on Snowflake 
  • AWS services such as EMR, Glue (serverless architecture), S3, Athena, IAM, Lambda and CloudWatch
  • Core Spark, Spark Streaming, DataFrame API, Data Set API, RDD APIs & Spark SQL programming dealing with processing terabytes of data
  • Advanced SQL using Hive/Impala framework including SQL performance tuning
  • Expertise in Hadoop, and other distributed computing frameworks 
  • ElasticSearch (OpenSearch) and Kibana Dashboards
  • Resource management frameworks such as Yarn or Mesos.
  • Physical table design in Big Data environment
  • External job schedulers such as autosys, AWS data pipeline, airflow etc.
  • Experience working in Key/Value data store such as Hbase

Data Analyst:

Skills, Experience and Requirements

  • Minimum of 5 years of experience delivering data solutions on a variety of data warehousing platforms.
  • Experience with SQL, Python and Excel in a business environment required
  • 2+ years of experience with Tableau developing calculated fields
  • Experience with data cleaning and blending multiple data sources using ETL tools
  • Experience in cloud technologies (like AWS) and data analytics platforms (ex: Redshift and Snowflake)
  • Experience in delivering of self-service analytics, insights, KPIs and metrics
  • Experience building and maintaining data catalog with dictionary 
  • Experience with scheduling tools like Control-M or Airflow
  • Strong understanding and experience with data warehousing concepts required
  • Experience manipulating large datasets in a business environment required
  • Experience translating data to actionable insights required
  • Excellent facilitation skills; Strong desire to communicate in all settings
  • Apply objective, analytical, and orderly thinking to the analysis of complex problems
  • Embrace the Adventure; Willing to take risks, try innovative approaches, be adaptable to change, and learn from failures
  • Demonstrate Curiosity; Strong desire to learn and add value to all aspects of the Dish business

Education and Experience:

  • Bachelor's Degree with 5 years of experience in a relevant field such as Business operations, Analytics and Computer science; Master & Degree a plus

  • Big Data

    2 weeks ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Must have:7+ years of years of dev experienceBig data developer with exposure to JavaSpark/Scala/Hive experienceGood background in SQLNice to have:Familiarity/Experience with Cloud*Mandatory Competencies*Big Data - Big Data - HIVEBig Data - Big Data - SPARKDatabase - Database Programming - SQLProgramming Language - Scala - ScalaBeh - Communication

  • Big Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Infosys Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Spark Scala• Primary skills:Technology->Big Data - Data Processing->Spark • Good knowledge on software configuration management systems • Strong business acumen, strategy and cross-industry thought leadership • Awareness of latest technologies and Industry trends • Logical thinking and problem solving skills along with an ability to collaborate •...

  • Senior Software Big Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Info Edge Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Key Responsibilities: -Design, develop, and maintain robust data pipelines using Kafka, Airflow, and Spark. -Implement data models and schemas for efficient querying. -Develop and optimize code in Scala and Java for data processing tasks. -Monitor and troubleshoot data pipeline performance, ensuring data integrity and availability. -Collaborate with...

  • Big Data Lead

    4 days ago

    Noida, Uttar Pradesh, India Briskwin IT Solutions Full time ₹ 1,20,000 - ₹ 6,00,000 per year

    Exp: 6-9yrs**Work location : Pune/Chennai/Mumbai/Noida/Coimbatore/BangaloreWork Mode: Hybrid**Notice Period : Imm – 30 daysMandatory skills : SSIS + MongoDB + SQLJob Title: Data Engineer Experience: 5+ yearsJob Description: We are looking for an experienced Data Engineer with strong expertise in building and managing data pipelines, integrating diverse...

  • Data Engineer

    6 days ago

    Noida, Uttar Pradesh, India Delhivery Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    About Delhivery:Delhivery is India's leading fulfillment platform for digital commerce. With a vast logistics network spanning 18,000+ pin codes and over 2,500 cities, Delhivery provides a comprehensive suite of services including express parcel transportation, freight solutions, reverse logistics, cross-border commerce, warehousing, and cutting-edge...

  • Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Cloudkeeper Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Position Overview:We are looking for an experienced and driven Data Engineer to join our team. The ideal candidate will have a strong foundation in big data technologies, particularly Spark, and a basic understanding of Scala to design and implement efficient data pipelines. As a Data Engineer at CloudKeeper, you will be responsible for building and...

  • QA Engineer

    11 hours ago

    Noida, Uttar Pradesh, India Big Oh Tech Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are seeking a highly skilled and motivated QA Engineer (Manual Testing) with expertise in Python and. NET to join our dynamic team. You will play a critical role in ensuring the quality and reliability of our products through thorough manual testing. Your proficiency in Python and. NET will be essential in creating comprehensive testing frameworks and...

  • Data Engineer II

    6 days ago

    Noida, Uttar Pradesh, India Microsoft Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.  Microsoft's Azure Data engineering team is leading the transformation of analytics in the world of...

  • Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India CloudKeeper Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : About CLOUDKEEPER : CloudKeeper is a cloud cost optimization partner that combines the power of group buying & commitments management, expert cloud consulting & support, and an enhanced visibility & analytics platform to reduce cloud cost & help businesses maximize the value from AWS, Microsoft Azure, & Google Cloud. A certified AWS...

  • Senior Data Engineer

    2 days ago

    Noida, Uttar Pradesh, India RateGain Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    About RateGainRateGain Travel Technologies Limited is a global provider of AI-powered SaaS solutions for travel and hospitality that works with 3,200+ customers and 700+ partners in 100+ countries helping them accelerate revenue generation through acquisition, retention, and wallet share expansion. RateGain today is one of the world's largest processors of...