Data Engineering Manager

1 week ago


Gurgaon, Haryana, India HuQuo Full time
Manager - Data Engineer

Job Responsibilities :
Create and maintain optimal data pipeline architecture,

  • Assemble large, complex data sets that meet functional/nonfunctional business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, redesigning infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Work with stakeholders including the Executive, Product, Data and Design teams to assist with datarelated technical issues and support their data infrastructure needs.
  • Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
  • Work with data and analytics experts to strive for greater functionality in our data systems.

Qualifications for Data Engineer :

  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience building and optimizing 'big data' data pipelines, architectures and data sets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
  • Strong project management and organizational skills.
  • Experience supporting and working with crossfunctional teams in a dynamic environment.
  • We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
They should also have experience using the following software/tools:

  • Experience with big data tools: Hadoop, Spark, Kafka, etc.
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift
  • Experience with streamprocessing systems: Storm, Spark-Streaming, etc.
  • Experience with objectoriented/object function scripting languages: Python, Java, C++, Scala, etc.
)

  • Gurgaon, Haryana, India Skyleaf Full time

    We are looking for an experienced Azure Cloud and Data Engineering Manager to support our Enterprise Data Environment and provide strategic and technical direction to help deliver solutions using cloud-based : Manager - Azure Cloud and Data Engineering Manager Experience : 10-14 Years Location : Gurugram (Hybrid) Shift Timing : 2PM-11PM Key...


  • Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description : The Data Engineering Team primarily work with the lead data engineer, product owners, architects, engineering teams and BI developers to implement and drive forward data & analytics goals within Risk. This is an opportunity to work as a "hands on" data engineer, engaging with a variety of stakeholders in engineering teams and the business...


  • Gurgaon, Haryana, India GEMINI Full time

    Department : Analytics Data is central to all of our business functions and drive many of our most important decisions at Gemini. As a result, the analysts, scientists, and engineers that make up the Data team are uniquely positioned to advise and influence cross-functional projects. These projects cover a wide-range of topics including product strategy,...


  • Gurgaon, Haryana, India Spectral Consultant Full time

    Spectral Consultants is looking for a Data Engineering Manager to join their team at a financial services organization.Experience: 10+ yearsRequirements:Extensive experience with Azure Cloud strategies & industry best practicesStrong skills in data management, data modeling, data services, reporting, and analytics toolsProficiency with SQL Server, Mongo DB,...


  • Gurgaon, Haryana, India Spectral Consultant Full time

    Spectral Consultants is looking for a Data Engineering- Manager to join a renowned financial services organization.Requirements:Experience: 10+ yearsExpertise in data management, data modeling, data services, reporting, and analytics.Familiarity with SQL Server, Mongo DB, PostgreSQL, and Azure Cloud applications.Proficiency in selfservice Business...


  • Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time

    GCP Data Engineer role involves designing, developing, and maintaining data pipelines and infrastructure on Google Cloud Platform (GCP). The position demands expertise in data engineering practices, cloud architecture, and big data technologies. The ideal candidate collaborates with data scientists, analysts, and stakeholders to ensure efficient, reliable...


  • Gurgaon, Haryana, India Publicis Sapient Full time

    Job Description : As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...


  • Gurgaon, Haryana, India Macquarie Group Full time

    Senior Data Engineer Join our tooling division, focused on uplifting data management, regulatory reporting, and record management capabilities across Macquarie. At Macquarie, we are working to create lasting value for our communities, our clients, and our people. We are a global financial services group operating in 34 markets and with 54 years of...

  • Data Engineer

    1 week ago


    Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time

    Role Overview : We are looking for a go getter person who can define: Analytics strategies to meet the demands of business requirements Technical requirements of the analytic solutions Data requirements of the analytic solution processes The person will be part of the Data Science and Engineering team for a major Insurance client. He/ She will work with...

  • Data Engineer

    1 week ago


    Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description :Role Overview :We are looking for a go-getter person who can define :Data strategies to meet the demands of business requirements Technical requirements of the organizational data needs from diverse teams Data architecture, models and goforward data solutions for various teams of the organization The person will be part of the Data Solutions...

  • Data Engineer

    1 week ago


    Gurgaon, Haryana, India TransOrg Analytics Full time

    Location : Gurgaon/Mumbai Job ID : DE2008 Job Type : Full time Experience : 2-6 years Why would you like to join us? TransOrg Analytics, an award winning – Big Data and Predictive analytics- company, offers advanced analytics solutions to industry leaders and Fortune 500 companies across India, US, UK, Singapore and the Middle East. Our...

  • Data Engineer

    1 week ago


    Gurgaon, Haryana, India Teleparty Full time

    Teleparty is hiring Data Engineers Join Teleparty, a premium remote entertainment service leading the charge in making social TV a global cultural phenomenon bigger than the movies. With over 10 million streamers who have installed our Netflix focused browser extension - Teleparty, we operate the largest social TV service in the world for millions of...

  • Data Engineer

    1 week ago


    Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time

    Role & Responsibilities Overview : A seasoned data team member with a good grasp of both business and technical aspects.Good familiarity with data stack Interact with the other members of the data governance team, business teams to understand requirements and also collaborate with stewards / data custodians / end users etc Demonstrated experience of building...

  • Structural Engineer

    1 week ago


    Gurgaon, Haryana, India Padink Engineering Full time

    Job DescriptionPerform structural analysis and design for onshore projects using STAAD Pro software.Prepare detailed engineering calculations, drawings, and specifications.Collaborate with multidisciplinary teams to develop innovative and cost-effective solutions.Conduct site visits and inspections to ensure compliance with design standards.Review project...

  • Data Engineer

    1 week ago


    Gurgaon, Haryana, India Unifocus Full time

    Job Description Data Engineer Unifocus is an integrated workforce management software platform offering intelligent automation for daily work orders management, housekeeping activities, facility maintenance, survey solutions, scheduling & labour management, and time & attendance built for the hospitality market and other dynamic scheduling environment. We...

  • Data Engineer

    1 week ago


    Gurgaon, Haryana, India Ezeiatech Systems Private Limited Full time

    Roles & Responsibilities : Creating and managing data pipelines from various disparate sources. Leveraging Big Data technologies to enhance our home-grown Data Platform. Ensuring a high degree of data quality, scalability, and availability. Working on PoC's for selected technologies that are yet to be adopted. Working closely with Data Scientists to...

  • Data Engineer

    1 week ago


    Gurgaon, Haryana, India dentsu Full time

    The purpose of this role is to maintain, improve, clean and manipulate data in the business's operational and analytics databases. The Data Engineer works with the business's software engineers, data analytics teams, data scientists. data warehouse engineers and business intelligence experts and data visualization specialists to understand and aid in the...

  • Lead Data Engineer

    1 week ago


    Gurgaon, Haryana, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies Write and tune complex Java, MapReduce, Pig and Hive jobs Adapt quickly to change in requirements...

  • Data Engineer

    1 week ago


    Gurgaon, Haryana, India Paisabazaar Full time

    Job Description : Qualifications for Data Engineer : 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements. 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java. Strong analytic skills to understand and create...

  • Data Engineer

    1 week ago


    Gurgaon, Haryana, India Acuity Knowledge Partners Full time

    Opportunity- Data Engineer ( Associate/ Senior Associate) Location- Gurugram (Hybrid) "Immediate joiners are highly preferred " Key Responsibilities: Partner with data strategy and sourcing team on data requirements to design data pipelines and delivery structures. Engage with vendors and technical teams to systematically ingest, evaluate, and create...