Senior Data Engineer

2 weeks ago

Jaipur, Rajasthan, India Dotsquares Technologies Full time

Technical Experience and Expertise :

- When working as a Senior Data Engineer you will leverage azure stack tools based on requirements for developing data integration workflows.

- Familiarity with these tools and an understanding of when to use each one is crucial for optimizing data processing, movement, and transformation in a cloud-based environment.

1. Azure Data Factory, Fivetran, Talend, Informatica etc.

2. Azure Logic Apps\Function Apps.

3. Azure Stream Analytics.

4. Azure Data Lake Storge.

5. Azure Databricks.

6. Azure Synapse Analytics & Azure Data Explorer.

7. Snowflake.

8. Power BI - Optional.

Data Integration and Design :

- Implement data integration and ETL processes to ingest data from various sources into Azure data storage solutions.

- Ensure efficient and secure data transfer and transformation.

- Pattern based templates combined with Control Framework models for processing large volumes of initial and incremental data with observability.

- Design and implement scalable, high-performance data solutions on the Azure cloud platform.

- Develop and maintain data models, schemas, and structures to support business needs.

Azure Services :

- Utilize a range of Azure data services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Snowflake, and others to build end-to-end data solutions.

- Implement and optimize data storage solutions using Snowflake, Azure SQL Database, Azure Data Lake Storage, etc.

Data Processing and Analysis :

- Develop and optimize queries for data analysis and reporting.

- Implement data processing solutions for real-time and batch processing scenarios.

Data Security and Compliance :

- Implement security measures to protect sensitive data.

- Ensure compliance with data governance and regulatory requirements.

Monitoring and Optimization :

- Monitor and optimize data pipelines and processing for performance and reliability.

- Troubleshoot and resolve issues related to data engineering processes.

Collaboration :

- Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions.

Documentation :

- Document data architecture, data pipelines, processes, and best practices.

- Create and maintain documentation for data engineering solutions.

Scalability :

- Design solutions that can scale with the growth of data and business needs.

- Implement strategies for data partitioning, indexing, and optimization.

Qualifications :

- Bachelor's degree in computer science, Information Technology, or related field.

- 5+ years of experience in data engineering, with a focus on cloud platforms.

- Strong proficiency in Azure services for data engineering.

- Experience with ETL tools, data modelling, and database design.

- Solid understanding of data warehousing concepts and best practices.

- Programming skills in languages such as Python, SQL, or others.

- Excellent problem-solving and troubleshooting skills.

- Strong communication and collaboration skills.

(ref:hirist.tech)

  • Analyst

    2 days ago

    Jaipur, Rajasthan, India Data Engineer Full time

    Data Engineer (ML & GenAI Deployment)We are seeking a Data Engineer to deploy Machine Learning, Vision Language Models, and Large Language Models into production using cloud platforms.Key Responsibilities:Build and manage data pipelines to support ML, VLM, and LLM model deploymentDeploy ML and GenAI using cloud deployment platformsWork closely with data...

  • Senior Data Engineer

    7 hours ago

    Jaipur, Rajasthan, India CYAN360 Full time

    Job Title: Senior Snowflake Data EngineerPosition: Full Time/ContractLocation: RemoteSalary: OpenWork Timings: 3:00 PM to 11:00 PM IST**Need someone who can join in 15 daysDescription:Need senior Snowflake Data Engineer with atleast 8 years of IT experience.Must have atleast 3 to 4 years of experience with Snowflake.Must have strong experience with ADF...

  • Senior Data Engineer

    7 days ago

    Jaipur, Rajasthan, India beBee Careers Full time

    Brief Job OverviewAs a seasoned Senior Big Data Engineer, you will play a pivotal role in designing and implementing robust data processing pipelines using Apache Spark.

  • Senior Data Engineer

    6 days ago

    Jaipur, Rajasthan, India beBee Careers Full time

    Senior Data EngineerAre you a skilled data engineer looking to take your career to the next level? We have an exciting opportunity for a senior data engineer with experience in Apache Spark and Python. Your primary responsibility will be designing and developing scalable data architectures and pipelines that support business-critical insights and...

  • Senior Data Engineer

    4 days ago

    Jaipur, Rajasthan, India beBee Careers Full time

    Senior Data Engineer - Ab InitioJob Title: Senior Data Engineer - Ab InitioJob Description:We are seeking an experienced Ab Initio Developer to lead our data engineering team. As a Senior Data Engineer, you will be responsible for designing and developing large-scale data integration systems that handle complex data processing workflows.Your focus will be on...

  • Senior Data Engineer

    7 days ago

    Jaipur, Rajasthan, India beBee Careers Full time

    Senior Data Engineer - Cloud DWHWe are seeking an experienced Senior Data Engineer to lead our cloud-based Data Warehousing (DWH) projects. The ideal candidate will have a strong background in designing and architecting data solutions, with expertise in AWS and ETL/ELT processes.Main Responsibilities:Designing and implementing end-to-end technical solutions...

  • Senior Data Engineer

    21 hours ago

    Jaipur, Rajasthan, India beBee Careers Full time

    Senior Data EngineerAbout the PositionThe Senior Data Engineer will lead the design, development, and maintenance of large-scale data processing systems using Serverless Glue and PySpark. This role requires expertise in AWS Lake Formation and experience in setting up and managing data lakes.Responsibilities:Data Engineering: Develop and maintain ETL jobs to...

  • Senior Data Engineer

    2 days ago

    Jaipur, Rajasthan, India Sky Systems, Inc. (SkySys) Full time

    body{font-family:Arial;}h1{color:#00698f;}h2{color:#008000;}p{text-align:justify;}Sky Systems Inc. - Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to join our team.Key Responsibilities:Data Engineering and Development: Develop and maintain ETL jobs using Serverless Glue and PySpark to process data from various...

  • Senior Cloud Data Engineer

    5 days ago

    Jaipur, Rajasthan, India beBee Careers Full time

    Senior Cloud Data Engineer - Microsoft Fabric, Snowflake & Databricks Specialist\

  • Senior Data Engineer

    5 days ago

    Jaipur, Rajasthan, India Metadrob Full time

    Senior NLP EngineerMetadrob is seeking a highly skilled Senior NLP Engineer to join our team.ResponsibilitiesWe are looking for an experienced engineer who can build, fine-tune, and optimize NLP models for various use cases such as text generation, summarization, and classification.Develop and deploy state-of-the-art NLP systems that drive business...