Lead Data Engineer

2 weeks ago

bangalore, India Searce Inc Full time

Who we are? Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’. It signifies our way of working: To improve to the finest degree of excellence, ‘solving for better’ every time. Searcians are passionate improvers & solvers who love to question the status quo. The primary purpose of all of us, at Searce, is driving intelligent, impactful & futuristic business outcomes using new-age technology. This purpose is driven passionately by HAPPIER people who aim to become better, everyday. What are we looking for? Searce is looking for a Lead Data Engineer who is able to work with business leads, analysts, data scientists and fellow engineers to build data products that empower better decision making. Someone who is passionate about the data quality of our business metrics and geared up to provide flexible solutions that can be scaled up to respond to broader business questions. What you'll do as a Lead Data Engineer with us?1. Understand the business requirements and translate these to data services to solve the business and data problems 2. Develop and manage the transports/data pipelines (ETL/ELT jobs) and retrieve applicable datasets for specific use cases using cloud data platforms and tools 3. Explore new technologies and tools to design complex data modelling scenarios, transformations and provide optimal data engineering solutions 4. Build data integration layers to connect with different heterogeneous sources using various approaches 5. Understand data and metadata to support consistency of information retrieval, combination, analysis and reporting 6. Troubleshoot and monitor data pipelines to have high availability of reporting layer 7. Collaborate with many teams - engineering and business, to build scalable and optimized data solutions and propose ways to improve platform and tools 8. Effectively manages workstreams for self and 2 to 3 analysts to support delivery What are the must-haves to join us? Is Education overrated? Yes. We believe so. But there is no way to locate you otherwise. So we might look for at least a Bachelor’s degree in Computer Science and 1. 7-10 years of experience with building the data pipelines or data ingestion for both Batch/Streaming data from different sources to data warehouse / data lake 2. Experience leading and delivering data warehousing and analytics projects, including using cloud technologies such as EMR, Lambda, Cloud Storage, BigQuery, etc. 3. Experience of at-least 2 to 3 projects building and optimizing BigData data pipelines, architectures and datasets 4. Handson experience/knowledge with SQL/Python/Java/Scala programming, understanding of SQL is a must 5. Experience with any cloud computing platforms like AWS (S3, Lambda functions, RedShift, Athena), GCP (GCS, Dataflow, Dataproc, Pub/Sub, Bigquery), Azure (Blob/Azure, Synapse) etc. 6. Knowledge of version control software such as Git and experience in working with relevant hosting services (e.g. Azure DevOps, Github, Bitbucket, Gitlab)7. Strong experience working with relevant Python & R packages and ecosystems (e.g. pandas, NumPy, scikit-learn, tidyverse, data tables)8. Extensive experience in developing complex stored procedures and transformations 9. Experience/knowledge with Big Data tools (Hadoop, Hive, Spark, Presto) So, If you are passionate about tech, future & what you read above (we really are), apply here to experience the ‘Art of Possible’

  • Lead Data Engineer

    1 week ago

    bangalore, India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Lead Data Engineer

    1 week ago

    bangalore, India Eucloid Data Solutions Full time

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Sr. Data Science

    3 weeks ago

    Bangalore, India NTT DATA Full time

    Job Description Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Science & AIML, GenAI Lead/Engineer to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Lead Data Architect

    3 weeks ago

    Bangalore, Karnataka, India NTT DATA Full time

    NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Lead Data Architect to join our team in Bangalore Karnxc4x81taka IN-KA India IN Position Overview We are seeking a highly...

  • Lead data engineer

    3 weeks ago

    Bangalore, India ThinkWise Consulting LLP Full time

    Lead Data Engineer Experience - 10+ Years Location - Bengaluru Hybrid Model We are seeking a Lead Data Engineer to serve as the technical lead for the team responsible for managing and engineering customer data. The ideal candidate will have a strong background in data engineering and software development, with hands-on experience building scalable...

  • Lead Data Engineer

    7 days ago

    bangalore, India ATOM Systems Private Limited Full time

    Job DescriptionName of the position :  Data Engineer Location :   Coimbatore / Remote  No. of resources needed:  01  Mode:  Contract to Hire Years of experience:  15+ Years  About the Role We are seeking a highly skilled and driven Data Engineering Lead to lead our data engineering team. The ideal candidate combines strong...

  • Lead Data Engineer

    1 week ago

    bangalore, India ATOM Systems Private Limited Full time

    Job DescriptionName of the position : Data EngineerLocation :  Coimbatore / Remote No. of resources needed: 01 Mode: Contract to HireYears of experience: 15+ Years About the RoleWe are seeking a highly skilled and driven Data Engineering Lead to lead our data engineering team. The ideal candidate combines strong leadership and technical...

  • Data Engineering Lead

    4 weeks ago

    Bangalore, Karnataka, India Bloom Consulting Services Full time

    Programming Programming SQL nosql nosql Azure cloud Azure cloud Snowflake Snowflake Nodia Bangalore Hyderbad Full Time Experience 05 0 - 09 0 years Offered Salary 18 00 - 20 00 Notice Period Not Disclosed As a Data Engineering Lead you will play a pivotal role in designing and developing scalable data architectures data pipelines and...

  • Lead Data Engineer

    2 days ago

    Bangalore, India London Stock Exchange Group Full time

    Position : Lead Data Engineer Overview: We are seeking a highly skilled and motivated Data Engineer to join our innovative team. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. You will collaborate closely with cross-functional teams to...

  • Azure Data Engineer Lead

    3 days ago

    bangalore, India Creative Synergies Group Full time

    Creative Synergies Group OverviewCreative is a leading Global Technology Services firm delivering innovative solutions that build upon synergies between our Deep Engineering Domain Expertise and Digital Engineering ServicesWe work with clients across the Global Transportation, Energy/Process, Industrial Products, Hi-Tech, and EdTech verticalsCreative’s...