Lead Data Engineer

3 weeks ago

India, IN Searce Inc Full time

Who we are?Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’. It signifies our way of working: To improve to the finest degree of excellence, ‘solving for better’ every time. Searcians are passionate improvers & solvers who love to question the status quo.The primary purpose of all of us, at Searce, is driving intelligent, impactful & futuristic business outcomes using new-age technology. This purpose is driven passionately by HAPPIER people who aim to become better, everyday.What are we looking for?Searce is looking for a Lead Data Engineer who is able to work with business leads, analysts, data scientists and fellow engineers to build data products that empower better decision making. Someone who is passionate about the data quality of our business metrics and geared up to provide flexible solutions that can be scaled up to respond to broader business questions.What you'll do as a Lead Data Engineer with us?1. Understand the business requirements and translate these to data services to solve the business and data problems2. Develop and manage the transports/data pipelines (ETL/ELT jobs) and retrieve applicable datasets for specific use cases using cloud data platforms and tools3. Explore new technologies and tools to design complex data modelling scenarios, transformations and provide optimal data engineering solutions4. Build data integration layers to connect with different heterogeneous sources using various approaches5. Understand data and metadata to support consistency of information retrieval, combination, analysis and reporting6. Troubleshoot and monitor data pipelines to have high availability of reporting layer7. Collaborate with many teams - engineering and business, to build scalable and optimized data solutions and propose ways to improve platform and tools8. Effectively manages workstreams for self and 2 to 3 analysts to support deliveryWhat are the must-haves to join us?Is Education overrated? Yes. We believe so. But there is no way to locate you otherwise. So we might look for at least a Bachelor’s degree in Computer Science and1. 7-10 years of experience with building the data pipelines or data ingestion for both Batch/Streaming data from different sources to data warehouse / data lake2. Experience leading and delivering data warehousing and analytics projects, including using cloud technologies such as EMR, Lambda, Cloud Storage, BigQuery, etc.3. Experience of at-least 2 to 3 projects building and optimizing BigData data pipelines, architectures and datasets4. Handson experience/knowledge with SQL/Python/Java/Scala programming, understanding of SQL is a must5. Experience with any cloud computing platforms like AWS (S3, Lambda functions, RedShift, Athena), GCP (GCS, Dataflow, Dataproc, Pub/Sub, Bigquery), Azure (Blob/Azure, Synapse) etc.6. Knowledge of version control software such as Git and experience in working with relevant hosting services (e.g. Azure DevOps, Github, Bitbucket, Gitlab)7. Strong experience working with relevant Python & R packages and ecosystems (e.g. pandas, NumPy, scikit-learn, tidyverse, data tables)8. Extensive experience in developing complex stored procedures and transformations9. Experience/knowledge with Big Data tools (Hadoop, Hive, Spark, Presto)So, If you are passionate about tech, future & what you read above (we really are), apply here to experience the ‘Art of Possible’

  • Data Engineer

    3 weeks ago

    india, IN Data-Hat AI Full time

    Department: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Lead Data Engineer

    2 weeks ago

    india, IN ATOM Systems Private Limited Full time

    Job DescriptionName of the position : Data EngineerLocation : Coimbatore / Remote No. of resources needed: 01 Mode: Contract to HireYears of experience: 15+ Years About the RoleWe are seeking a highly skilled and driven Data Engineering Lead to lead our data engineering team. The ideal candidate combines strong leadership and technical expertise with the...

  • Cloud Data Delivery

    3 weeks ago

    india, IN Pacific Data Integrators Full time

    Core Technical & Domain SkillsExtensive hands-on experience with cloud modernization of ETL pipelines Strong data debugging skills and deep understanding of enterprise analytics stack Proven track record with at least one hyperscaler analytic environment with either (Databricks, Snowflake, etc.).Informatica (IDMC/CDGC) preferred; must be strong on IDMC or...

  • Analytics Data Engineer

    2 weeks ago

    india, IN GoDiverse Full time

    About GoDiverseAt GoDiverse, we're on a mission to reshape UK public procurement for the better. We are an early-stage tech company building an AI-powered platform to help public bodies discover and engage with Small and Medium-sized Enterprises (SMEs), driven by the new Procurement Act 2023. Our goal is to level the playing field for the 99.9% of UK...

  • Data Engineer

    1 week ago

    india, IN Insight Global Full time

    Position: GCP Data Engineer Location: 100% Remote in IndiaDuration: 12 month contract + extensions + conversionsPackage: 10 LPA- 26 LPAInterview Process: 2 RoundsREQUIRED SKILLS AND EXPERIENCE6+ Years of experience as a Data Engineer Experience with GCP Data ie. Big Query, Cloud Storage, BigTable, Airflow, Dataproc, Dataflow Strong SQL experience (NoSQL,...

  • Data Engineer

    2 weeks ago

    india, IN Response Informatics Full time

    We’re Hiring | Data Engineering Experts (Hyderabad / Remote)We’re looking for passionate and experienced Data Engineering professionals to join our growing team.If you love building scalable data pipelines, optimizing cloud-based workflows, and leading innovation in data infrastructure — we’d love to meet you! Open Positions:Data Engineer – 8 to...

  • Data Engineer

    2 weeks ago

    india, IN NuVision Auto Glass Full time

    NuVision Auto Glass is a leading auto glass service provider in the USA, serving customers across Arizona, Florida, South Carolina, and Colorado. Known for delivering reliable mobile windshield replacement and expert auto glass services, ensuring convenience and safety at every step.With seamless insurance claims, easy financing options for cash payments,...

  • Senior Lead Data Engineer

    3 weeks ago

    india, IN TerraFinn Technologies Full time

    Company DescriptionTerraFinn Technologies outsources scholars from various top business schools in India and experienced employees to Fintech companies globally. The company focuses on providing expert employees to help fintech companies grow their business and achieve their goals efficiently. TerraFinn Technologies values long-term relationships with both...

  • Data Engineer Lead

    3 weeks ago

    , India, IN CoffeeBeans Full time

    Experience5 - 8 yrsMode of WorkingHybrid (3 days WFO, 2 days WFH)LocationBangalore / PuneRoles and responsibilities-- Tech-lead in one of the feature teams, candidate need to be work along with team lead in handling the team without much guidance- Good communication and leadership skills- Nurture and build next level talent within the team- Work in...

  • Data Engineer

    3 weeks ago

    india, IN Randstad Enterprise Full time

    Role : Data EngineerLocation : RemoteShift Timing : 2:00 Pm - 11:00 PmExperience : 2- 4 years relevant only ( this is a Junior position with us )Must have skillset :GCP - 2 years minimum working Experience Python and Pyspark - 2 yearsSQL - 2 yearsExcellent communicationWorked with global stakeholdersWho we are:Randstad Sourceright’s global talent solutions...