Senior Data Engineer

3 days ago

Bengaluru, India ORANGEMINT TECHNOLOGIES PRIVATE LIMITED Full time

Job Description :


This role is responsible for the design, development, and maintenance of data integration and reporting solutions. The ideal candidate will possess expertise in Databricks and strong skills in SQL Server, SSIS and SSRS, and experience with other modern data engineering tools such as Azure Data Factory. This position requires a proactive and results-oriented individual with a passion for data and a strong understanding of data warehousing principles.

Responsibilities :

Data Integration :

- Design, develop, and maintain robust and efficient ETL pipelines and processes on Databricks.

- Troubleshoot and resolve Databricks pipeline errors and performance issues.

- Maintain legacy SSIS packages for ETL processes.

- Troubleshoot and resolve SSIS package errors and performance issues.

- Optimize data flow performance and minimize data latency.

- Implement data quality checks and validations within ETL processes.

Databricks Development :

- Develop and maintain Databricks pipelines and datasets using Python, Spark and SQL.

- Migrate legacy SSIS packages to Databricks pipelines.

- Optimize Databricks jobs for performance and cost-effectiveness.

- Integrate Databricks with other data sources and systems.

- Participate in the design and implementation of data lake architectures.

Data Warehousing

- Participate in the design and implementation of data warehousing solutions.

- Support data quality initiatives and implement data cleansing procedures.

Reporting and Analytics

- Collaborate with business users to understand data requirements for department driven reporting needs.

- Maintain existing library of complex SSRS reports, dashboards, and visualizations.

- Troubleshoot and resolve SSRS report issues, including performance bottlenecks and data Bachelor's degree in computer science, Information Systems, or a related field.

- 7+ years of experience in data integration and reporting.

- Extensive experience with Databricks, including Python, Spark, and Delta Lake.

- Strong proficiency in SQL Server, including T-SQL, stored procedures, and functions.

- Experience with SSIS (SQL Server Integration Services) development and maintenance.

- Experience with SSRS (SQL Server Reporting Services) report design and development.

- Experience with data warehousing concepts and best practices.

- Experience with Microsoft Azure cloud platform and Microsoft Fabric desirable.

- Strong analytical and problem-solving skills.

- Excellent communication and interpersonal skills.

- Ability to work independently and as part of a team.

- Experience with Agile methodologies.

(ref:hirist.tech)

  • Data Senior Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...

  • Data Senior Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA North America Full time US$ 1,00,000 - US$ 1,50,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: 8+ years of experience in a Data...

  • Senior, Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 1,04,000 - US$ 1,30,878 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Manager,...

  • Senior, Data Engineer

    17 hours ago

    Bengaluru, India NTT DATA Full time

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive. Your day at NTT DATAThe Manager,...

  • Senior Associate Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time

    Job DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive.Your day at NTT DATAThe...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Senior Associate Data Engineer

    3 days ago

    Bengaluru, India NTT DATA, Inc. Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive. Your day at NTT...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Senior Data Engineer About the RoleThis is an exciting opportunity to join our team as a senior data engineer. We are looking for a highly skilled and experienced professional who can design, develop, and implement large-scale data processing systems.

  • Senior Data Engineer

    7 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering Role OverviewWe are seeking a senior data engineer to drive business strategies through robust data pipelines.Develop and refine intricate ETL pipelines for processing high volumes of data.Maintain data precision, coherence, and system performance.Collaborate with cross-functional teams for impactful solutions.Implement top-notch practices...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and executing test cases for ETL processes and data pipelines.You will perform source-to-target data validation, data quality checks, and reconciliation using your strong expertise in SQL for...