Lead Data Engineer

2 weeks ago

Pune, Maharashtra, India Searce Inc Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Who we are?

Searce means 'a fine sieve' & indicates 'to refine, to analyze, to improve'. It signifies our way of working: To improve to the finest degree of excellence, 'solving for better' every time. Searcians are passionate improvers & solvers who love to question the status quo.

The primary purpose of all of us, at Searce, is driving intelligent, impactful & futuristic business outcomes using new-age technology. This purpose is driven passionately by HAPPIER people who aim to become better, everyday.

What are we looking for?

Searce is looking for a Lead Data Engineer who is able to work with business leads, analysts, data scientists and fellow engineers to build data products that empower better decision making. Someone who is passionate about the data quality of our business metrics and geared up to provide flexible solutions that can be scaled up to respond to broader business questions.

What you'll do as a Lead Data Engineer with us?

  1. Understand the business requirements and translate these to data services to solve the business and data problems

  2. Develop and manage the transports/data pipelines (ETL/ELT jobs) and retrieve applicable datasets for specific use cases using cloud data platforms and tools

  3. Explore new technologies and tools to design complex data modelling scenarios, transformations and provide optimal data engineering solutions

  4. Build data integration layers to connect with different heterogeneous sources using various approaches

  5. Understand data and metadata to support consistency of information retrieval, combination, analysis and reporting

  6. Troubleshoot and monitor data pipelines to have high availability of reporting layer

  7. Collaborate with many teams - engineering and business, to build scalable and optimized data solutions and propose ways to improve platform and tools

  8. Effectively manages workstreams for self and 2 to 3 analysts to support delivery

What are the must-haves to join us?

Is Education overrated? Yes. We believe so. But there is no way to locate you otherwise. So we might look for at least a Bachelor's degree in Computer Science and

  1. 7-10 years of experience with building the data pipelines or data ingestion for both Batch/Streaming data from different sources to data warehouse / data lake

  2. Experience leading and delivering data warehousing and analytics projects, including using cloud technologies such as EMR, Lambda, Cloud Storage, BigQuery, etc.

  3. Experience of at-least 2 to 3 projects building and optimizing BigData data pipelines, architectures and datasets

  4. Handson experience/knowledge with SQL/Python/Java/Scala programming, understanding of SQL is a must

  5. Experience with any cloud computing platforms like AWS (S3, Lambda functions, RedShift, Athena), GCP (GCS, Dataflow, Dataproc, Pub/Sub, Bigquery), Azure (Blob/Azure, Synapse) etc.

  6. Knowledge of version control software such as Git and experience in working with relevant hosting services (e.g. Azure DevOps, Github, Bitbucket, Gitlab)

  7. Strong experience working with relevant Python & R packages and ecosystems (e.g. pandas, NumPy, scikit-learn, tidyverse, data tables)

  8. Extensive experience in developing complex stored procedures and transformations

  9. Experience/knowledge with Big Data tools (Hadoop, Hive, Spark, Presto)

So, If you are passionate about tech, future & what you read above (we really are), apply here to experience the 'Art of Possible'

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Lead Data Engineer

    2 weeks ago

    Pune, Maharashtra, India North Hires Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionNorth Hires is a premier consulting firm specializing in Custom Software Development, Recruitment, Sourcing, and Executive Search services. Our mission is to empower businesses by providing them with the finest human capital. We strive to be the go-to consulting partner for companies seeking exceptional talent, fostering growth,...

  • Data Engineer Lead

    4 days ago

    Pune, Maharashtra, India Mappy Global Resources Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Greetings for the DayScouting for a Director, Data Engineering Lead to be associated with a Global Digital Media Agency.Location: PuneShift: EMEARole & responsibilitiesDirector, Data Engineering Lead, you will drive the architecture, design, and implementation of enterprise-scale data platforms and pipelines. You will lead a high-performing team of data...

  • Lead Software Engineer

    2 days ago

    Pune, Maharashtra, India Data Direct Networks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    OverviewThis is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to...

  • Lead Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Arting Digital Private Limited Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Posting title: Lead Data Engineer (Databricks)Experience: 7+ YearsLocation: Pune/ AhmedabadWork mode: HybridPrimary skills: Databricks, Data Modelling/ Data Lakehouse, Gen AI, SQL, Python/Scala, Azure Data Factory (ADF)/AWS Glue, Docker, Team LeadQualification: Any Technical DegreeRoles & Responsibilities:Lead the design, development, and optimization of...

  • Lead Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Arting Digital Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Posting title :Lead Data Engineer (Databricks)Experience :7+ YearsLocation :Pune/ AhmedabadWork mode :HybridPrimary skills :Databricks, Data Modelling/ Data Lakehouse, Gen AI, SQL, Python/Scala, Azure Data Factory (ADF)/AWS Glue, Docker, Team LeadQualification :Any Technical DegreeRoles & ResponsibilitiesLead the design, development, and optimization of data...

  • Lead Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Arting Digital Private Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position: Lead Data EngineerExperience: 7–10 yearsLocation: Pune / AhmedabadMode: HybridKey SkillsData Engineering, SQL, Python, Snowflake, dbt, Apache AirflowCloud Platforms: AWS / Azure / GCPCI/CD, Git, Infrastructure as Code (Terraform)Team Leadership & Stakeholder CollaborationResponsibilitiesDesign, build, and optimize scalable data pipelines...

  • lead data Engineer

    4 days ago

    Pune, Maharashtra, India Reveille Technologies,Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We're Hiring: Lead Data Engineer (FTE)Location:Pune / CoimbatoreExperience:5 to 12 yearsBudget:As per experienceNotice Period:Immediate joiners onlyWe're looking for aLead Data Engineerwith strong technical and leadership skills to join our growing team.Key Skills:PythonPySparkAWSDatabricksJava platform experience (desirable)Proven leadership and team...

  • Lead Data Engineer

    7 days ago

    Pune, Maharashtra, India Shashwath Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are seeking a skilled Lead Data Engineer with extensive experience in Snowflake, ADF, SQL, and other relevant data technologies to join our team. As a key member of our data engineering team, you will play an instrumental role in designing, developing, and managing data pipelines, working closely with cross-functional teams to drive the success of our...

  • Lead Data Engineer

    2 hours ago

    Pune, Maharashtra, India Mastercard Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships...