Big Data Engineer

2 weeks ago


Delhi, Delhi, India Findem Full time

What is Findem :

Findem is the only talent data platform that combines 3D data with AI. It automates and consolidates top-of-funnel activities across your entire talent ecosystem, bringing together sourcing, CRM, and analytics into one place.

Only 3D data connects people and company data over time making an individual's entire career instantly accessible in a single click, removing the guesswork, and unlocking insights about the market and your competition no one else can.

Powered by 3D data, Findem's automated workflows across the talent lifecycle are the ultimate competitive advantage. Enabling talent teams to deliver continuous pipelines of top, diverse candidates while creating better talent experiences, Findem transforms the way companies plan, hire, and manage talent.

Experience 4-7 years.

We are looking for an experienced Big Data Engineer, who will be responsible for building, deploying and managing various data pipelines, data lake and Big data processing solutions using Big data and ETL technologies.

Location : Delhi (preferred)/ Bangalore (Based out of these locations or ready to relocate to this locations).

Hybrid : 3 days onsite.

Role and Responsibilities :

- Build data pipelines, Big data processing solutions and data lake infrastructure using various Big data and ETL technologies.

- Assemble and process large, complex data sets that meet functional non-functional business requirements.

- ETL from a wide variety of sources like MongoDB, S3, Server-to-Server, Kafka etc., and processing using SQL and big data technologies.

- Build analytical tools to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.

- Build interactive and ad-hoc query self-serve tools for analytics use cases.

- Build data models and data schema for performance, scalability and functional requirement perspective.

- Build processes supporting data transformation, metadata, dependency and workflow management.

- Research, experiment and prototype new tools/technologies and make them successful.

Must have Skills :

- Strong in Python/Scala.

- Must have experience in Big data technologies like Spark, Hadoop, Athena / Presto, Redshift, Kafka etc.

- Experience in various file formats like parquet, JSON, Avro, orc etc.

- Experience in workflow management tools like airflow.

- Experience with batch processing, streaming and message queues.

- Any of visualization tools like Redash, Tableau, Kibana etc.

- Experience in working with structured and unstructured data sets.

- Strong problem solving skills.

Good to have Skills :

- Exposure to NoSQL like MongoDB.

- Exposure to Cloud platforms like AWS, GCP, etc.

- Exposure to Microservices architecture.

- Exposure to Machine learning techniques.

The role is full-time and comes with full benefits. We are globally headquartered in the San Francisco Bay Area with our India headquarters in Bengaluru.

Equal Opportunity :

As an equal opportunity employer, we do not discriminate on the basis of race, color, religion, national origin, age, sex (including pregnancy), physical or mental disability, medical condition, genetic information, gender identity or expression, sexual orientation, marital status, protected veteran status or any other legally-protected characteristic.

(ref:hirist.tech)
  • Big Data Engineer

    3 weeks ago


    Delhi, Delhi, India Easy Recruit Global Full time

    Job Description :- Strong proficiency in data engineering techniques, including ETL processes, data modeling, and database design.- In-depth knowledge of big data technologies like Apache Spark, Hadoop, and cloud services such as AWS, Azure, or GCP.- Strong problem-solving and troubleshooting skills to identify and resolve performance issues within data...

  • Big Data Engineer

    2 weeks ago


    Delhi, Delhi, India Easy Recruit Global Full time

    Job Description :- Strong proficiency in data engineering techniques, including ETL processes, data modeling, and database design.- In-depth knowledge of big data technologies like Apache Spark, Hadoop, and cloud services such as AWS, Azure, or GCP.- Strong problem-solving and troubleshooting skills to identify and resolve performance issues within data...

  • Big Data Engineer

    3 weeks ago


    Delhi, Delhi, India Findem Full time

    What is Findem : Findem is the only talent data platform that combines 3D data with AI. It automates and consolidates top-of-funnel activities across your entire talent ecosystem, bringing together sourcing, CRM, and analytics into one place. Only 3D data connects people and company data over time - making an individual's entire career instantly accessible...

  • Big Data Engineer

    4 weeks ago


    Delhi, Delhi, India Findem Full time

    What is Findem : Findem is the only talent data platform that combines 3D data with AI. It automates and consolidates top-of-funnel activities across your entire talent ecosystem, bringing together sourcing, CRM, and analytics into one place. Only 3D data connects people and company data over time - making an individual's entire career instantly accessible...


  • Delhi, Delhi, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Position - Senior Big Data Engineer (GCP) Experience - 5 to 8 Years Location - Remote Shift Time - EST Shift (5:30 PM to 2:30 AM) Position Overview :- We are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The...

  • Big Data Engineer

    1 day ago


    Delhi, Delhi, India Droisys Full time

    Job Description:Droisys is a dynamic and innovative company that provides advanced data engineering solutions. We are seeking an experienced Big Data Engineer to join our team. In this role, you will work closely with our cross-functional teams to design and develop data pipelines that meet the company's requirements.Your Key Responsibilities:• Designing...


  • Delhi, Delhi, India LTIMindtree Full time

    Primary Skills: GCP- Big query, pub-sub, GCS, dataflow, SQL, PythonExpereince: 3 to 8 yearsNotice Period- Immediate to 30 days.Must have experience in software design and development experience in the data engineering field is preferredHands on experience in GCP cloud data implementation suite such as Big Query Pub Sub Data Flow Apache Beam Airflow Composer...

  • Big Data Architect

    3 weeks ago


    Delhi, Delhi, India Easy Recruit Global Full time

    Job Summary :The Big Data Architect will be responsible for designing, implementing, and managing large-scale data systems, ensuring they are scalable, secure, and aligned with business objectives. The role involves working with a variety of data technologies, cloud platforms, and legacy systems to create integrated solutions that support advanced analytics,...

  • Big Data Architect

    2 weeks ago


    Delhi, Delhi, India Easy Recruit Global Full time

    Job Summary :The Big Data Architect will be responsible for designing, implementing, and managing large-scale data systems, ensuring they are scalable, secure, and aligned with business objectives. The role involves working with a variety of data technologies, cloud platforms, and legacy systems to create integrated solutions that support advanced analytics,...


  • Delhi, Delhi, India NucleusTeq Consulting Pvt. Ltd. Full time

    Role : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good attitude toward learning the domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.- Finalizing the scope of the system and...

  • AWS Big Data Engineer

    2 weeks ago


    Delhi, Delhi, India Vy systems Full time

    Job Title : AWS Bigdata Engineer (Spark, Scala)Job Description : Responsibilities :- Design, develop, and maintain scalable data pipelines using Spark and Scala.- Implement data processing workflows on AWS services like S3, Redshift, Glue, and EMR.- Collaborate with data scientists and analysts to ensure data availability and quality.- Optimize data storage...


  • Delhi, Delhi, India Ministry Of Electronics And Information Technology Full time

    Data Scientist CollaborationWork closely with data scientists, analysts, and other stakeholders to support their data needs. Provide technical guidance and support to team members on data engineering best practices. Ensure data systems comply with government regulations and data protection laws. Implement security measures to protect data integrity and...

  • Big Data Consultant

    2 weeks ago


    Delhi, Delhi, India Synechron Full time

    Good-day,We have immediate opportunity forBig Data Lead – 9 yearsJob Role:Big Data LeadJob Location:PuneExperience-9 yearsNotice Period : Immediate to 15 DaysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver...


  • Delhi, Delhi, India Upamp Business Solutions Full time

    About the advertising data flow team :The advertising data flow team is responsible for the streaming and batch data processes that power our reporting, analytics, attribution, forecasting, optimization, ad delivery, and billing systems with a business focus on accurately associating real-world visits to digital media impressions and growing our connected TV...


  • Delhi, Delhi, India MM Management Consultant Full time

    About Company OverviewMM Management Consultant is a leading global consulting firm specializing in Open Source, Cloud, and Automation technologies. Our team has extensive experience delivering complex solutions that drive business growth and efficiency.Job DescriptionLead the design and development of scalable data pipelines using big data processing...

  • Big Data Developer

    3 days ago


    Delhi, Delhi, India Hexaware Technologies Full time

    Big Data DevelopmentWe are seeking a Big Data Developer to join our team at Hexaware Technologies. As a Big Data Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Azure Databricks. The ideal candidate should have 6-12 years of experience in IT, with a minimum of 4 years of experience in...


  • Delhi, Delhi, India MWIDM Staffing Services Full time

    Job Opportunity : Python Developer - Big Data & Code Generation FrameworkWe are looking for a skilled and experienced Python Developer to join our team and contribute to building a Python-based code generation framework and runtime engine that interacts with a Business Rules repository.Note : Please read the JD carefully before applying-Key Responsibilities...


  • Delhi, Delhi, India MWIDM Staffing Services Full time

    Job Opportunity : Python Developer - Big Data & Code Generation FrameworkWe are looking for a skilled and experienced Python Developer to join our team and contribute to building a Python-based code generation framework and runtime engine that interacts with a Business Rules repository.Note : Please read the JD carefully before applying-Key Responsibilities...

  • Data Engineering

    2 weeks ago


    Delhi, Delhi, India Upamp Business Solutions Full time

    Job Description :This is a senior-level engineering role where the candidate would be a part of the Data Engineering team distributed in the US and India. They are expected to provide technical leadership, be fully hands-on, and lead by example. They are expected to architect complete end-to-end solutions/data pipelines; data ingestion, ETL, reporting, and...


  • Delhi, Delhi, India DXC Luxoft Full time

    Project Description : We've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products. Responsibilities : - Choosing the right technologies for our use cases, deploy and operate. - Setting up...