Lead Data Engineer

2 weeks ago

Bengaluru, India Calfus Inc. Full time
About Calfus
Calfus is a Silicon Valley headquartered software engineering and platforms company. The name Calfus finds its roots and ethos in the Olympic motto “Citius, Altius, Fortius – Communiter". Calfus seeks to inspire our team to rise faster, higher, stronger, and work together to build software at speed and scale.
Our core focus lies in creating engineered digital solutions that bring about a tangible and positive impact on business outcomes. We stand for #Equity and #Diversity in our ecosystem and society at large. Connect with us at #Calfus and be a part of our extraordinary journey
Position Overview:
As a Lead/Sr. Data Engineer – BI Analytics & DWH , you will play a pivotal role in designing and implementing comprehensive business intelligence solutions that empower our organization to make data-driven decisions. You will leverage your expertise in Power BI, Tableau, and ETL processes to create scalable architectures and interactive visualizations. This position requires a strategic thinker with strong technical skills and the ability to collaborate effectively with stakeholders at all levels.
Key Responsibilities:
BI Architecture & DWH Solution Design: Develop and design scalable BI Analytical & DWH Solution that meets business requirements, leveraging tools such as Power BI and Tableau.
Data Integration: Oversee the ETL processes using SSIS to ensure efficient data extraction, transformation, and loading into data warehouses.
Data Modelling: Create and maintain data models that support analytical reporting and data visualization initiatives.
Database Management: Utilize SQL to write complex queries, stored procedures, and manage data transformations using joins and cursors.
Visualization Development: Lead the design of interactive dashboards and reports in Power BI and Tableau, adhering to best practices in data visualization.
Collaboration: Work closely with stakeholders to gather requirements and translate them into technical specifications and architecture designs.
Performance Optimization: Analyse and optimize BI solutions for performance, scalability, and reliability.
Data Governance: Implement best practices for data quality and governance to ensure accurate reporting and compliance.
Team Leadership: Mentor and guide junior BI developers and analysts, fostering a culture of continuous learning and improvement.
Azure Databricks: Leverage Azure Databricks for data processing and analytics, ensuring seamless integration with existing BI solutions.
Qualifications:
Bachelor’s degree in computer science, Information Systems, Data Science, or a related field.
6-15 years of experience in BI architecture and development, with a strong focus on Power BI and Tableau/Looker.
Should have experience in working with ERP (Oracle EBS, SAP, Netsuite) and CRM (Salesforce) as data sources for BI Solutions
Should have worked on data integration: Azure/Data Factory, DBT/Fivetran, Python, SQL
Proven experience with ETL processes and tools, especially SSIS. Strong proficiency in SQL Server, including advanced query writing and database management.
Exploratory data analysis with Python
Familiarity with the CRISP-DM model
Ability to work with different data models like
Familiarity with databases like Azure Database, Snowflake/Big Query, Postgres, Redshift & Mongo DB, DW Concept Star Schema.
Experience with visualization tools such as Power BI, Quick sight and Plotly and or Dash
Strong programming foundation with Python with versatility to handle as :
Data Manipulation and Analysis: using Pandas, NumPy & PySpark, data serialization & formats like JSON, CSV and Parquet & Pickle. Database interaction to query cloud-based data warehouses
Data Pipeline and ETL tools like Airflow for orchestrating workflows and, managing ETL pipeline Scripting and automation. Cloud services & tools such as S3, AWS Lambda to manage cloud infrastructure. Azure SDK is a plus
Code quality and management using version control and collaboration in data engineering projects
Ability to interact with REST API’s and perform web scraping tasks is a plus
Calfus Inc. is an Equal Opportunity Employer.
That means we do not discriminate against any applicant for employment, or any employee because of age, colour, sex, disability, national origin, race, religion, or veteran status. All employment is decided based on qualifications, merit, and business need.

  • Data Engineer Lead

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineer LeadData Engineers within NTT DATA Services drive the creation of innovative data solutions that benefit our clients. As a Data Engineer Lead, you will be responsible for leading diverse data engineering activities on the Azure Data platform, including the development and delivery of data pipelines connecting various enterprise data sources,...

  • Data engineer

    3 weeks ago

    Bengaluru, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    2 months ago

    Bengaluru, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    2 months ago

    Bengaluru, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    1 month ago

    Bengaluru, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...

  • Lead Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description:We are seeking a skilled Lead Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will be responsible for designing and implementing high-level design documents, building ETL code in Databricks, and performing unit and system integration testing.Responsibilities:Design and implement high-level...

  • Data Engineer

    1 month ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Diverse Data Engineering Activities on Azure Data PlatformMain Responsibilities:Design and develop big data processing notebooks using Azure DatabricksLead the data identification, data analysis efforts for data sources and work directly with data owner teamsDevelop data requirements for new data sourcesDesign and development...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Data Engineer - Cloud Solutions Diverse Data Engineering activities on Azure Data platform. Build & Deliver Data pipeline connecting various enterprise data sources. Develop data mappings to existing data sources. Design and develop big data processing notebooks using Azure Databricks. Scripting and programming using programming languages...

  • Data Science

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewWe are seeking an experienced Data Science & AI Engineer to lead our machine learning initiatives and drive innovation in artificial intelligence.About the RoleThe successful candidate will have a strong background in developing and implementing traditional machine learning algorithms, with experience deploying models in production environments....

  • Data Engineer

    3 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 301314 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: As a data...

  • (15h Left) Data Engineer

    4 weeks ago

    Bengaluru, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.- Lead the architecture, design, and delivery of enterprise grade microservices.- Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionReq ID: 301470NTT DATA is seeking a skilled Data Engineer to partner with stakeholders across business units to develop analyses and documentation in a collaborative way.The ideal candidate will have three or more years of experience with Python, SQL, and data visualization/exploration tools, as well as familiarity with the AWS ecosystem.About...

  • Data-Driven Customer Experience Lead

    6 days ago

    Bengaluru, Karnataka, India Hevo Data Full time

    About Hevo Data:We are a leading provider of fully managed Automated Pipelines, used by thousands of data-driven companies worldwide. Our mission is to enable every company to be data-driven, and we're looking for an experienced Customer Experience Lead to join our team.As a Customer Experience Lead at Hevo Data, you will be responsible for ensuring...

  • Digital Engineering Lead Engineer

    1 month ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionReq ID: 299336 NTT DATA is seeking a talented Digital Engineering Lead Engineer to join our team in Bangalore, Karnātaka, India. This role is part of our JavaScript and Web Platform engineering practice, where you will be surrounded by top-notch engineers and have plenty of interesting challenges.Key Responsibilities:Write code, create unit...

  • Senior SAP Data Migration Lead

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the Role:-Sr Syniti ADM Consultant:As a highly experienced SAP Data Migration Consultant, you will lead the execution of data migration projects from SAP ECC to SAP S4/HANA, utilizing your expertise in data cleansing, profiling, and harmonization. Your proficiency in project planning, cutover planning, and gathering business requirements is essential...

  • Digital Engineering Lead Engineer

    1 month ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 299336 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).How We...

  • Data Engineering Specialist

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Requirements:NTT DATA Services is seeking a skilled Data Engineer to join our team in Bangalore, India. In this role, you will work closely with the GenAI architect to design and implement automated data pipelines.Key Responsibilities:Analyze and understand source data, preparing and managing data sets for actionable insights.Collaborate with Data...

  • Digital Engineering Lead Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 295081 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job...

  • Data Engineering Cloud Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineering Cloud SpecialistAbout the RoleWe are seeking an experienced Data Engineer to join our team at NTT DATA. This is a fantastic opportunity to work on diverse data engineering activities on Azure Data platform and contribute to building a robust data pipeline connecting various enterprise data sources.About YouTo be successful in this...

  • GCP Lead Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled GCP Lead Engineer to join our team at NTT DATA. This role is ideal for someone with expertise in designing and implementing Google Cloud Platform (GCP) solutions.Key ResponsibilitiesAssess, design, and implement GCP solutions, including compute, network, storage, identity, security, and disaster recovery.Develop and...