Lead data engineer

4 weeks ago

Junagadh, India Searce Inc Full time

Who we are? Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’. It signifies our way of working: To improve to the finest degree of excellence, ‘solving for better’ every time. Searcians are passionate improvers & solvers who love to question the status quo. The primary purpose of all of us, at Searce, is driving intelligent, impactful & futuristic business outcomes using new-age technology. This purpose is driven passionately by HAPPIER people who aim to become better, everyday. What are we looking for? Searce is looking for a Lead Data Engineer who is able to work with business leads, analysts, data scientists and fellow engineers to build data products that empower better decision making. Someone who is passionate about the data quality of our business metrics and geared up to provide flexible solutions that can be scaled up to respond to broader business questions. What you'll do as a Lead Data Engineer with us? 1. Understand the business requirements and translate these to data services to solve the business and data problems 2. Develop and manage the transports/data pipelines (ETL/ELT jobs) and retrieve applicable datasets for specific use cases using cloud data platforms and tools 3. Explore new technologies and tools to design complex data modelling scenarios, transformations and provide optimal data engineering solutions 4. Build data integration layers to connect with different heterogeneous sources using various approaches 5. Understand data and metadata to support consistency of information retrieval, combination, analysis and reporting 6. Troubleshoot and monitor data pipelines to have high availability of reporting layer 7. Collaborate with many teams - engineering and business, to build scalable and optimized data solutions and propose ways to improve platform and tools 8. Effectively manages workstreams for self and 2 to 3 analysts to support delivery What are the must-haves to join us? Is Education overrated? Yes. We believe so. But there is no way to locate you otherwise. So we might look for at least a Bachelor’s degree in Computer Science and 1. 7-10 years of experience with building the data pipelines or data ingestion for both Batch/Streaming data from different sources to data warehouse / data lake 2. Experience leading and delivering data warehousing and analytics projects, including using cloud technologies such as EMR, Lambda, Cloud Storage, Big Query, etc. 3. Experience of at-least 2 to 3 projects building and optimizing Big Data data pipelines, architectures and datasets 4. Handson experience/knowledge with SQL/Python/Java/Scala programming, understanding of SQL is a must 5. Experience with any cloud computing platforms like AWS (S3, Lambda functions, Red Shift, Athena), GCP (GCS, Dataflow, Dataproc, Pub/Sub, Bigquery), Azure (Blob/Azure, Synapse) etc. 6. Knowledge of version control software such as Git and experience in working with relevant hosting services (e.g. Azure Dev Ops, Github, Bitbucket, Gitlab) 7. Strong experience working with relevant Python & R packages and ecosystems (e.g. pandas, Num Py, scikit-learn, tidyverse, data tables) 8. Extensive experience in developing complex stored procedures and transformations 9. Experience/knowledge with Big Data tools (Hadoop, Hive, Spark, Presto) So, If you are passionate about tech, future & what you read above (we really are), apply here to experience the ‘Art of Possible’

  • Leading Cloud Data Engineer

    1 week ago

    junagadh, India beBeeDataEngineer Full time

    Data Engineer Job DescriptionAs a seasoned Data Engineer, you will be responsible for designing and developing scalable data processing systems on Google Cloud Platform (GCP). Your expertise in GCP services such as Dataflow, BigQuery, and Storage Classes will enable our organization to extract insights from complex data sets and make informed business...

  • Experienced Lead Data Engineer

    2 weeks ago

    junagadh, India beBeeDataEngineer Full time

    About the JobWe are seeking a highly skilled and experienced professional to lead our data engineering team in building and optimizing data ingestion and transformation pipelines.Design, develop, and maintain scalable data pipelines using Azure Data Platform, Databricks, Snowflake, and Kafka.Key ResponsibilitiesDevelop end-to-end solutions for operational...

  • Databricks Data Engineer Lead

    2 days ago

    junagadh, India beBeeDataEngineer Full time

    Azure Databricks Job DescriptionWe are seeking a seasoned data engineer to lead the development and maintenance of large-scale data processing pipelines on Azure Databricks.Strong understanding of big data architecture, including data warehousing, ETL/ELT processes, and data governanceExpertise in managing distributed computing environments, optimizing...

  • Data Engineering Lead

    2 weeks ago

    junagadh, India beBeeData Full time

    We are seeking a Senior Data Engineer to join our team. This role is responsible for designing, building, and scaling robust data pipelines that power nationwide analytics and support machine learning systems.This position involves working with large datasets, designing efficient data processing workflows, and ensuring the quality and reliability of...

  • Data Engineering Project Lead

    2 weeks ago

    junagadh, India beBeeTechnical Full time

    Project Leadership Opportunity:As a skilled Technical Project Manager, you will lead and deliver projects in data engineering and analytics. This includes managing cross-functional teams to execute data platform, pipeline, and analytics initiatives, ensuring alignment with business goals and timely delivery.Develop and execute project plans that meet time,...

  • Carbon Footprint Data Engineer Lead

    2 weeks ago

    junagadh, India beBeeData Full time

    Carbon Footprint Data Engineer Lead This is a key role in an enterprise-wide sustainability initiative. Job Description: The successful candidate will be responsible for building data pipelines and models to support product-level carbon footprint analysis. This involves developing and optimizing ETL/ELT pipelines on Databricks using PySpark and SQL to...

  • Lead Data Architect

    2 days ago

    junagadh, India beBeeDataScientist Full time

    Senior Data EngineerWe are seeking a Senior Data Engineer to lead the design, development, and optimization of data platforms and streaming pipelines that power data products, analytics, and AI/ML initiatives.This role will collaborate closely with data scientists, ML engineers, product managers, and business stakeholders to build robust, scalable, and...

  • Chief Data Engineering Lead

    2 weeks ago

    junagadh, India beBeeDataStrategist Full time

    Enterprise Data VisionaryThe role requires spearheading the design and implementation of large-scale enterprise data analytics solutions.Develop comprehensive end-to-end data architecture and roadmaps for education data platforms.Lead the design and implementation of robust ETL/ELT pipelines and orchestration systems.Design and optimize data warehouses/data...

  • Data Solutions Lead

    2 days ago

    junagadh, India beBeeDataLead Full time

    Job OverviewAs a seasoned technical leader, you will spearhead the design and implementation of data-driven solutions across various domains.You will provide strategic guidance to engineering teams and ensure high-quality, compliant delivery for pharma clients.Technical Leadership: Provide architectural direction and vision for data programs.Solution Design:...

  • Data Architect Engineer

    1 week ago

    junagadh, India beBeeData Full time

    Data Architect EngineerWe are seeking a skilled Data Architect Engineer to lead modern data engineering projects.Lead large-scale SQL workload migrations from on-premise environments to cloud platforms, ensuring high data integrity and minimal downtime.Design and develop end-to-end data pipelines for migration and ETL processes, leveraging cloud-based data...