Paisabazaar - Data Engineer - Big Data Technologies

4 weeks ago


GurgaonGurugram, IN Paisabazaar.com Full time

Job Description :


Qualifications for Data Engineer :

  • 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements.
  • 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java.
  • Strong analytic skills to understand and create solutions for business use cases.
  • Ensure best practices to implement data governance principles, data quality checks on each data layer.
  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
  • Strong project management and organizational skills.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
We are looking for a candidate with 4+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.

They should also have experience using the following software/tool :
  • Experience with big data tools: Hadoop, Hive, Spark, Kafka, Airflow.
  • Experience with relational SQL and NoSQL databases: MySQL, Postgres and Cassandra.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with AWS/Azure cloud services: EC2, EMR, RDS, Redshift, HDInsights, DataLake, DataBricks
  • Experience with stream-processing systems: Storm, Spark-Streaming, etc.
  • Experience with object-oriented/object function scripting languages: Java, Python, Scala, etc.

(ref:hirist.tech)

  • Gurgaon/Gurugram, IN Impetus Technologies India Pvt. Ltd Full time

    Qualifications :- 3.5-7 years of IT experience range is preferred.- The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.- Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.- Exposure to enterprise application...

  • Big Data Developer

    4 weeks ago


    Gurgaon/Gurugram, IN Rocket Consulting Full time

    Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...


  • Gurgaon/Gurugram, IN Waytogo Consultants Full time

    Job Description :In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

  • Big Data Developer

    4 weeks ago


    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...


  • Gurgaon/Gurugram, IN Bigfoot Retail Solutions Pvt. Ltd Full time

    Job Description :- Design and build data pipelines from various cloud data sources for the enterprise data warehouse- Partner with Data Engineers, Data architects, domain experts, data analysts and other teams to build foundational data sets that are trusted, well understood, aligned with business strategy and enable self-service- Own and document data...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN Huquo Consulting Full time

    Role : Data EngineerLocation : GurgaonDesignation : AM- AVP (as per interview performance & EXL fitment)Work Timings : 1pm- 10pmRole Overview :We are looking for a go getter person who can define :1. Analytic strategies to meet the demands of business requirements2. Technical requirements of the analytic solutions3. Data requirements of the analytic solution...


  • Gurgaon/Gurugram, IN COFORGE Full time

    Job Description :As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...

  • Big Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Big Data Engineer Must-Have :- 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins,...

  • AWS Data Architect

    4 weeks ago


    Bangalore/Chennai/Gurgaon/Gurugram/Hyderabad/Pune, IN Huquo Full time

    Role Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and...

  • Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, IN Impetus Technologies India Pvt. Ltd Full time

    Job Description :4-7 years of IT experience range is preferred.Able to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services.Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function.Strong experience in Big Data technologies - Hadoop, Sqoop, Hive and Spark...

  • Data Scientist

    4 weeks ago


    Delhi NCR/Delhi/Gurgaon/Gurugram/Noida/Faridabad/Greater Noida/Ghaziabad/UP, IN fingertips data intelligence solutions Full time

    We are looking for Data Scientist - Predictive Analysis and Classification for Delhi location.Responsibilities :Predictive Modelling :- Develop and implement advanced predictive models using machine learning algorithms.- Apply statistical analysis and feature engineering to optimize model performance.- Collaborate with cross-functional teams to translate...


  • Gurgaon/Gurugram, IN Huquo Full time

    Job Description :- Analytic strategies to meet the demands of business requirements- Technical requirements of the analytic solutions- Data requirements of the analytic solution processes- The person will be part of the Data Science team for a major Insurance client. He/ She will work with different stakeholders as SME for data engineering- Engages in...

  • Publicis Sapient

    4 weeks ago


    Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full time

    Job Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal data pipeline architecture- Assemble large, complex data sets that meet functional / non-functional business requirements- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing...

  • Data Engineer

    1 week ago


    Bangalore/Pune/Kolkata/Gurgaon/Gurugram/Mumbai/Ahmedabad, IN Sterlite Technologies Limited Full time

    Role as a Data engineer :- Develop and build AI/ML model ready data ponds using Azure Databricks Delta lake- Improve upon the data ingestion models, ETL jobs, and alarm to maintain data integrity and data availability.- Partner with AI/ML product teams proactively identify the data needs for rapid experimentation, stable production deployment and ensure the...

  • Solution Architect

    4 weeks ago


    Bangalore/Gurgaon/Gurugram/Chandigarh, IN USEReady Technology Pvt. Ltd. Full time

    Job Title : Solutions Architect (Data & BI)Job Description : Solutions Architect (Data & BI) with around 10 - 15 years of experience in the following areas,Mandatory Skills :- Tableau, Big Data, Hadoop, Data Warehousing, Legacy BI Migrations, Cloud technologies.- Experienced in BI Implementation, BI migration involving Tableau.Preferred Skills : Starburst,...

  • Curate Data Analytics

    4 weeks ago


    Gurgaon/Gurugram, IN Curate Data Analytics LLP Full time

    About the Job : Senior Power BI DeveloperWe at Curate Data Analytics (A Startup in Business Analytics & Strategy space) are on a look out for a dynamic leader who knows Power BI very well, to be part of our Business Intelligence reporting Team. The incumbent is required to have a good understanding of business analytics & reporting using Power BI in FMCG...

  • Amantya Technologies

    4 weeks ago


    Gurgaon/Gurugram, IN Amantya Technologies Full time

    Title : MLOps Platform EngineerExperience : 7yrs-10yrsLocation : GurgaonAbout the Role : We are seeking a highly skilled and motivated MLOps Platform Engineer to join our team. The ideal candidate will be responsible for developing, maintaining, and enhancing our MLOps platform, which integrates data ingestion, preprocessing, workflow orchestration, and...


  • Bangalore/Gurgaon/Gurugram/Noida, IN MakeMyTrip Full time

    Requirements :Extensive experience working with large data sets with hands-on technology skills to design and build robust data architecture.Extensive experience in data modeling and database design.At least 6+ years of hands-on experience in Spark/Bigdata Tech stack.Stream processing engines - Spark Structured Streaming/Flink.Analytical processing on Big...

  • Big Data Developer

    4 weeks ago


    Bangalore/Hyderabad/Noida/Gurgaon/Gurugram/Indore, IN ARR Recruitment Solutions Full time

    Requirement :- Solid Experience of software development experience and leading teams of engineers and scrum teams.- 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and Java).- Solid Data warehousing concepts.- Knowledge of Financial reporting ecosystem will be a plus.- 4+ years of experience within Data Engineering/ Data...