Big Data Engineering

3 days ago

Noida, Uttar Pradesh, India prudentialmanp Full time ₹ 12,00,000 - ₹ 36,00,000 per year
  • Bachelor's degree in computer science, or similar technical field
  • Minimum 5 years of experience in Big Data Engineering/Data Analysis

Preferred Skills and Qualifications:

  • Proficiency in Python, SQL and Apache Spark
  • Strong Experience on Snowflake 
  • AWS services such as EMR, Glue (serverless architecture), S3, Athena, IAM, Lambda and CloudWatch
  • Core Spark, Spark Streaming, DataFrame API, Data Set API, RDD APIs & Spark SQL programming dealing with processing terabytes of data
  • Advanced SQL using Hive/Impala framework including SQL performance tuning
  • Expertise in Hadoop, and other distributed computing frameworks 
  • ElasticSearch (OpenSearch) and Kibana Dashboards
  • Resource management frameworks such as Yarn or Mesos.
  • Physical table design in Big Data environment
  • External job schedulers such as autosys, AWS data pipeline, airflow etc.
  • Experience working in Key/Value data store such as Hbase

Data Analyst:

Skills, Experience and Requirements

  • Minimum of 5 years of experience delivering data solutions on a variety of data warehousing platforms.
  • Experience with SQL, Python and Excel in a business environment required
  • 2+ years of experience with Tableau developing calculated fields
  • Experience with data cleaning and blending multiple data sources using ETL tools
  • Experience in cloud technologies (like AWS) and data analytics platforms (ex: Redshift and Snowflake)
  • Experience in delivering of self-service analytics, insights, KPIs and metrics
  • Experience building and maintaining data catalog with dictionary 
  • Experience with scheduling tools like Control-M or Airflow
  • Strong understanding and experience with data warehousing concepts required
  • Experience manipulating large datasets in a business environment required
  • Experience translating data to actionable insights required
  • Excellent facilitation skills; Strong desire to communicate in all settings
  • Apply objective, analytical, and orderly thinking to the analysis of complex problems
  • Embrace the Adventure; Willing to take risks, try innovative approaches, be adaptable to change, and learn from failures
  • Demonstrate Curiosity; Strong desire to learn and add value to all aspects of the Dish business

Education and Experience:

  • Bachelor's Degree with 5 years of experience in a relevant field such as Business operations, Analytics and Computer science; Master & Degree a plus

  • Big Data

    2 weeks ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Must have:7+ years of years of dev experienceBig data developer with exposure to JavaSpark/Scala/Hive experienceGood background in SQLNice to have:Familiarity/Experience with Cloud*Mandatory Competencies*Big Data - Big Data - HIVEBig Data - Big Data - SPARKDatabase - Database Programming - SQLProgramming Language - Scala - ScalaBeh - Communication

  • Big Data Engineer

    3 days ago

    Noida, Uttar Pradesh, India 1hresource Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Responsibilities:* Design, develop & maintain big data pipelines using Spark, Hive & Hadoop.* Optimize performance through data modeling & query optimization.* Collaborate with cross-functional teams on project delivery.Food allowanceAnnual bonusHealth insuranceOffice cab/shuttleProvident fund

  • Senior Software Big Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Info Edge Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Key Responsibilities: -Design, develop, and maintain robust data pipelines using Kafka, Airflow, and Spark. -Implement data models and schemas for efficient querying. -Develop and optimize code in Scala and Java for data processing tasks. -Monitor and troubleshoot data pipeline performance, ensuring data integrity and availability. -Collaborate with...

  • Big Data Lead

    3 days ago

    Noida, Uttar Pradesh, India Briskwin IT Solutions Full time ₹ 1,20,000 - ₹ 6,00,000 per year

    Exp: 6-9yrs**Work location : Pune/Chennai/Mumbai/Noida/Coimbatore/BangaloreWork Mode: Hybrid**Notice Period : Imm – 30 daysMandatory skills : SSIS + MongoDB + SQLJob Title: Data Engineer Experience: 5+ yearsJob Description: We are looking for an experienced Data Engineer with strong expertise in building and managing data pipelines, integrating diverse...

  • SE-Big Data

    6 days ago

    Greater Noida, Uttar Pradesh, India Bold Technology Systems Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company OverviewBOLD is revolutionising the career landscape by empowering individuals to discover and develop their professional paths. Our recent acquisitions of Monster and CareerBuilder will expand our global reach and impact. With a range of brands like FlexJobs, Zety, and Sonara and more, we provide job seekers with the tools to create impressive...

  • Big Data Hadoop ETL || 6-10 Years || Noida

    3 days ago

    Noida, Uttar Pradesh, India Creator City Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for an experienced Big Data Engineer who has strong hands-on experience in Big Data ecosystem tools, database engineering, and ETL pipeline development. The ideal candidate should have strong analytical and problem-solving skills along with expertise in performance tuning and scheduling tools.Key ResponsibilitiesDesign, develop, and optimize...

  • Data Engineer, Cross Border Data Engineering

    5 days ago

    Noida, Uttar Pradesh, India Amazon Full time ₹ 12,00,000 - ₹ 25,00,000 per year

    As a data engineer, you will be building business pipelines to integrate tech systems to data layer to enable reporting.Key job responsibilitiesManaging AWS resources including EC2,Redshift,EMR-Spark etcCollaborate with Product Managers, Financial and Business analysts to recognize and help adopt best practices in reporting and analysis: data integrity, test...

  • Data Engineer II

    6 days ago

    Noida, Uttar Pradesh, India Microsoft Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.  Microsoft's Azure Data engineering team is leading the transformation of analytics in the world of...

  • Data Engineer I, Data Engineering India

    5 days ago

    Noida, Uttar Pradesh, India Amazon Full time ₹ 8,00,000 - ₹ 15,00,000 per year

    As a data engineer are you looking for opportunity to be among software developers, machine learning scientists to build a data platform that not only caters to BI and reporting but also extends to machine learning applications.As a data engineer in AEE, you will: Design, implement and support an analytical data infrastructure serving both business...

  • Data Engineer, Cross Border Data Engineering

    4 days ago

    Noida, Uttar Pradesh, India Amazon Full time ₹ 80,000 - ₹ 1,80,000 per year

    DESCRIPTIONAs a data engineer, you will be building business pipelines to integrate tech systems to data layer to enable reporting. Key job responsibilitiesManaging AWS resources including EC2,Redshift,EMR-Spark etc Collaborate with Product Managers, Financial and Business analysts to recognize and help adopt best practices in reporting and analysis: data...