Senior Data Engineer

4 weeks ago

Jaipur, Rajasthan, India Dotsquares Technologies Full time

Technical Experience and Expertise :

- When working as a Senior Data Engineer you will leverage azure stack tools based on requirements for developing data integration workflows.

- Familiarity with these tools and an understanding of when to use each one is crucial for optimizing data processing, movement, and transformation in a cloud-based environment.

1. Azure Data Factory, Fivetran, Talend, Informatica etc.

2. Azure Logic Apps\Function Apps.

3. Azure Stream Analytics.

4. Azure Data Lake Storge.

5. Azure Databricks.

6. Azure Synapse Analytics & Azure Data Explorer.

7. Snowflake.

8. Power BI - Optional.

Data Integration and Design :

- Implement data integration and ETL processes to ingest data from various sources into Azure data storage solutions.

- Ensure efficient and secure data transfer and transformation.

- Pattern based templates combined with Control Framework models for processing large volumes of initial and incremental data with observability.

- Design and implement scalable, high-performance data solutions on the Azure cloud platform.

- Develop and maintain data models, schemas, and structures to support business needs.

Azure Services :

- Utilize a range of Azure data services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Snowflake, and others to build end-to-end data solutions.

- Implement and optimize data storage solutions using Snowflake, Azure SQL Database, Azure Data Lake Storage, etc.

Data Processing and Analysis :

- Develop and optimize queries for data analysis and reporting.

- Implement data processing solutions for real-time and batch processing scenarios.

Data Security and Compliance :

- Implement security measures to protect sensitive data.

- Ensure compliance with data governance and regulatory requirements.

Monitoring and Optimization :

- Monitor and optimize data pipelines and processing for performance and reliability.

- Troubleshoot and resolve issues related to data engineering processes.

Collaboration :

- Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions.

Documentation :

- Document data architecture, data pipelines, processes, and best practices.

- Create and maintain documentation for data engineering solutions.

Scalability :

- Design solutions that can scale with the growth of data and business needs.

- Implement strategies for data partitioning, indexing, and optimization.

Qualifications :

- Bachelor's degree in computer science, Information Technology, or related field.

- 5+ years of experience in data engineering, with a focus on cloud platforms.

- Strong proficiency in Azure services for data engineering.

- Experience with ETL tools, data modelling, and database design.

- Solid understanding of data warehousing concepts and best practices.

- Programming skills in languages such as Python, SQL, or others.

- Excellent problem-solving and troubleshooting skills.

- Strong communication and collaboration skills.

(ref:hirist.tech)

  • Senior Data Engineer

    2 days ago

    Jaipur, Rajasthan, India beBee Careers Full time

    Brief Job OverviewAs a seasoned Senior Big Data Engineer, you will play a pivotal role in designing and implementing robust data processing pipelines using Apache Spark.

  • Senior Data Engineer

    2 days ago

    Jaipur, Rajasthan, India beBee Careers Full time

    Senior Data EngineerAre you a skilled data engineer looking to take your career to the next level? We have an exciting opportunity for a senior data engineer with experience in Apache Spark and Python. Your primary responsibility will be designing and developing scalable data architectures and pipelines that support business-critical insights and...

  • Senior Data Engineer

    2 days ago

    Jaipur, Rajasthan, India beBee Careers Full time

    Senior Data Engineer - Cloud DWHWe are seeking an experienced Senior Data Engineer to lead our cloud-based Data Warehousing (DWH) projects. The ideal candidate will have a strong background in designing and architecting data solutions, with expertise in AWS and ETL/ELT processes.Main Responsibilities:Designing and implementing end-to-end technical solutions...

  • Senior Data Engineering Manager

    2 days ago

    Jaipur, Rajasthan, India beBee Careers Full time

    Senior Data Architect - Snowflake Job DescriptionWe are looking for an experienced Senior Data Architect to design and implement data solutions using Snowflake. The ideal candidate will have 12+ years of experience in data engineering and a minimum of 8-10 years of experience in developing and scaling data warehouse and data lake...

  • Senior Data Engineering Specialist

    2 weeks ago

    Jaipur, Rajasthan, India beBee Careers Full time

    Data Engineering Solutions\We are seeking a highly skilled Senior Data Engineer to join our team and lead the design, development, and implementation of large-scale data engineering solutions on the Azure cloud platform.\Responsibilities:\\Design and develop scalable, high-performance data solutions using Azure cloud services.\Implement data integration and...

  • Senior Data Engineer

    2 days ago

    Jaipur, Rajasthan, India beBee Careers Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Luxoft. As a critical team member, you will be responsible for developing the means to collect and ingest data, developing data models and data architectures, creating automated data pipelines, and taking the lead in making these production-ready.You will work...

  • Cloud Data Engineer

    10 hours ago

    Jaipur, Rajasthan, India beBee Careers Full time

    Senior Data Engineer Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have over 10 years of experience in data engineering, with a strong background in Azure Data Factory (ADF), Data Lake, Snowflake, Python, and Databricks.The candidate should also have experience in data ingestion into data...

  • Data Engineer

    2 days ago

    Jaipur, Rajasthan, India beBee Careers Full time

    About this roleSenior Data Engineer PositionWe are seeking a Senior Data Engineer to join our Professional Services team. As a key member of our team, you will be responsible for designing and implementing scalable batch processing systems using Python and big data technologies.Key Responsibilities:Design and implement scalable batch processing systems using...

  • Senior Data Engineering Specialist

    1 week ago

    Jaipur, Rajasthan, India beBee Careers Full time

    Job DescriptionWe are seeking a skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data warehousing and business intelligence solutions.The ideal candidate will have a strong background in data engineering, with experience in working...

  • Data Engineering Professional

    1 day ago

    Jaipur, Rajasthan, India beBee Careers Full time

    Senior Data Engineering PositionThis is a full-time remote role for a Senior Azure Data Engineer (Contract-to-Hire). The role involves tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics.Key ResponsibilitiesData Engineering: Design, implement, and maintain large-scale data systemsData Modeling: Develop robust...