Senior Data Engineer

5 days ago

Gandhinagar, India smartSense Consulting Solutions Full time

Job Description:

As a Senior Data Engineer at smartSense, you will be a key person in designing, building, and optimizing data pipelines and solutions using the Azure stack. Your role will involve collaborating with cross-functional teams such as ML engineers, data analysts, other data engineers, pre-sales team and stakeholders to ensure our data infrastructure supports business goals and drives data-driven decision-making. You will also mentor team members, manage project timelines, and effectively communicate with stakeholders or customers, foster a collaborative environment by actively engaging with team members, promoting teamwork and ensuring alignment across the team to achieve common goals.


Key Responsibilities:

  • Design & Development: Architect, design, and develop scalable and efficient data pipelines and ETL processes using Azure technologies.
  • Data Streaming: Implement and manage data streaming solutions for real-time or batch data processing.
  • Data Migration: Oversee data migration projects, ensuring seamless transitions of the data and maintaining data integrity.
  • ETL & ELT: Build and optimize ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes as needed.
  • Data Processing: Process and analyze large volumes of data to extract valuable insights.
  • Data Warehousing: Design and manage data warehousing solutions to support business intelligence and analytics.
  • Mentorship: Mentor and guide junior team members, providing support and fostering theirs and yours professional growth.
  • Stakeholder Communication: Communicate effectively with stakeholders to gather requirements, provide updates, and ensure alignment with business objectives.
  • Time Estimation: Estimate time and resources required for project completion and manage timelines effectively.
  • Self-Starter: Proactively identify areas for improvement, take initiative on projects, and work independently with minimal supervision.


Technical Skills:

  • Programming Languages: Proficiency in Python, C# .NET, or Java.
  • SQL & Scripting: Advanced skills in SQL query writing, scripting, and PL/SQL or T-SQL.
  • Databases: Experience with MS SQL Server, Azure SQL DB and Azure Cosmos DB for NoSQL/MongoDB highly desirable.
  • Azure Services: Expertise in Azure Data Factory, Azure Event Hub, Azure Databricks, Azure Storage, Other Azure services. Nice to have Azure Synapse Analytics, and Azure Functions.
  • Data Visualization: Will be added as an advantage if you have knowledge of Power BI for data visualization and reporting.
  • Big Data Technologies: Experience with Apache Spark and Snowflake for big data processing and warehousing.


Qualifications:

  • Bachelor’s degree in Computer Science, Engineering, or a related field (Master’s degree preferred).
  • 5+ years of experience as a Data Engineer, with a focus on Azure technologies.
  • Highly experienced in designing and implementing data pipelines, data migration, and data warehousing solutions.
  • Have the ability to work effectively under pressure.
  • Excellent communication and interpersonal skills.


  • Senior Data Engineer

    3 days ago

    Gandhinagar, India smartSense Consulting Solutions Full time

    As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining our clients’ data infrastructure. You will work mainly with snowflake and other variety of tools and technologies to manage and process data, optimize queries, and ensure data integrity. The ideal candidate will have extensive experience with SQL, Snowflake, data...

  • Senior Data Engineer

    4 days ago

    gandhinagar, India smartSense Consulting Solutions Full time

    As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining our clients’ data infrastructure. You will work mainly with snowflake and other variety of tools and technologies to manage and process data, optimize queries, and ensure data integrity. The ideal candidate will have extensive experience with SQL, Snowflake, data...

  • Senior Data Engineer

    5 days ago

    Gandhinagar, India smartSense Consulting Solutions Full time

    As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining our clients’ data infrastructure. You will work mainly with snowflake and other variety of tools and technologies to manage and process data, optimize queries, and ensure data integrity. The ideal candidate will have extensive experience with SQL, Snowflake, data...

  • Senior Data Engineer

    1 day ago

    gandhinagar, India smartSense Consulting Solutions Full time

    As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining our clients’ data infrastructure. You will work mainly with snowflake and other variety of tools and technologies to manage and process data, optimize queries, and ensure data integrity. The ideal candidate will have extensive experience with SQL, Snowflake, data...

  • Senior Data Engineer

    5 days ago

    Gandhinagar, India smartSense Consulting Solutions Full time

    As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining our clients’ data infrastructure. You will work mainly with snowflake and other variety of tools and technologies to manage and process data, optimize queries, and ensure data integrity. The ideal candidate will have extensive experience with SQL, Snowflake, data...

  • Senior Data Engineer

    4 days ago

    gandhinagar, India smartSense Consulting Solutions Full time

    Job Description: As a Senior Data Engineer at smartSense, you will be a key person in designing, building, and optimizing data pipelines and solutions using the Azure stack. Your role will involve collaborating with cross-functional teams such as ML engineers, data analysts, other data engineers, pre-sales team and stakeholders to ensure our data...

  • Senior Data Engineer

    5 days ago

    Gandhinagar, India smartSense Consulting Solutions Full time

    Job Description: As a Senior Data Engineer at smartSense, you will be a key person in designing, building, and optimizing data pipelines and solutions using the Azure stack. Your role will involve collaborating with cross-functional teams such as ML engineers, data analysts, other data engineers, pre-sales team and stakeholders to ensure our data...

  • Senior Data Engineer

    24 hours ago

    gandhinagar, India smartSense Consulting Solutions Full time

    Job Description: As a Senior Data Engineer at smartSense, you will be a key person in designing, building, and optimizing data pipelines and solutions using the Azure stack. Your role will involve collaborating with cross-functional teams such as ML engineers, data analysts, other data engineers, pre-sales team and stakeholders to ensure our data...

  • Senior Data/Data Analyst

    1 month ago

    Gandhinagar, India JioSaavn Full time

    Job Title: Senior Data / Data Analyst - Business InsightsLocation - Navi MumbaiOUR STORY:JioSaavn is India’s leading audio streaming service to access, discover, and listen to favourite songs & Podcasts across languages and genres. We blend digital technology, data analysis (which we have affectionately coined Music Science), and a strong, fearless...

  • Senior DevOps Engineer with Data Engineer background

    2 weeks ago

    gandhinagar, India Hanuma InfoTech Full time

    Overview: We are looking for a strong DevOps Engineer who has Data Engineering background with Java Services, UI Services and L3 Support experience is required.  Job Summary: We are seeking a talented and experienced Software Engineer to join our team at JLL. As a Software Engineer, you will be responsible for designing, developing, and supporting software...

  • Senior Data Scientist

    5 months ago

    Gandhinagar, India ATech Full time

    Job Profile : Senior Data ScientistJob description- We are seeking a highly skilled and collaborative Senior Data Scientist to join our team- Reporting to the Director of Data Science, you will work alongside and provide technical guidance to a subset of our Analytics and Insights group and provide support to a few business lines including Industry and...

  • Data Engineer

    4 weeks ago

    Gandhinagar, India BlockTXM Inc Full time

    - 6 years of experience as a Data Engineer or similar role- Proficiency in Azure, Python, and Databricks- Strong understanding of data management and data processing frameworks- Experience with data warehousing and ETL processes- Excellent problem-solving and analytical skills- Good communication and teamwork abilities

  • Data Engineer

    2 weeks ago

    Gandhinagar, India TravelOperations Full time

    We are looking for a Data Engineer to support our client's data management and analytics requirements within the Microsoft D365 ecosystem, with a primary focus on Delta Lake architecture. In this role, you will be responsible for building and maintaining data pipelines, troubleshooting issues, and ensuring data accuracy across platforms like Azure Synapse...

  • Data Engineer

    2 weeks ago

    Gandhinagar, India HCLTech Full time

    Exp - 5+ YearsLocation - Chennai & BangaloreJob Profile:Hadoop/Omnia Dev Engineers To develop and deliver codes for the work assigned in accordance with time| quality and cost standards Job responsibilities: •Interact with business stake holders and designers to implement to understand business requirements. •Hadoop development and implementation....

  • aws data engineer

    4 weeks ago

    Gandhinagar, India Astrosoft Technologies Full time

    Skill Set -1AWS Data Engineer Required Skills-AWS Spark and Spark Streaming-AWS Redshift,-AWS S3-AWS DMS for Data Replication - Nice to Have-AWS Step Functions , Airflow-AWS Glue is preferred-Good understanding of AWS Data and Analytics solutions.Able to understand the clients' requirements and project requirements and develop low latency (near real time and...

  • Head Data Management

    2 weeks ago

    gandhinagar, India AMINA Bank Full time

    About AMINA AMINA India is a wholly owned subsidiary of AMINA Bank AG, a FINMA licensed Swiss Bank focused on cryptocurrencies and digital assets. AMINA provides custody, trading, credit and investment products on cryptocurrencies and digital assets to institutional and professional investors. AMINA Bank is Headquartered in Zug, with presence in Mumbai, Abu...

  • Senior Data Analyst

    2 weeks ago

    gandhinagar, India HNR Tech Full time

    Overview: As a Data Analyst specializing in Inventory Management and Reporting for e-commerce, you will play a pivotal role in driving data-informed decisions for online retail businesses. Utilizing your expertise in MySQL, Power BI, and experience with e-commerce platforms like Walmart, Amazon, eBay, and ACC, you will deliver actionable insights that...

  • Senior Application Engineer

    2 weeks ago

    Gandhinagar, India Synopsys Inc Full time

    Senior Application Engineer / Staff Application EngineerKey Qualifications Must have B.Tech or M.Tech with 4-8 years of relevant experience.Good knowledge of Physical design, STA, Physical Verification and Parasitic Extraction methodologies.Proficiency in Unix, a strong understanding of ASIC design flow.Knowledge of Analog Mixed Signal flows will be an added...

  • HVAC Design Engineer

    2 weeks ago

    gandhinagar, India Oorja Energy Engineering Services Full time

    HVAC DESIGN ENGINEER Role & responsibilities Understanding the design requirements and preparing the design brief. Heat load calculation based on architectural drawings. Ability to research, design, draft specifications of equipment related to Radiant Cooling & Heating, Solar Thermal Projects. Ability to calculate the pump head and flow rate required...

  • Senior Deep Learning Engineer

    1 day ago

    gandhinagar, India Vidurta Full time

    Job description – Senior Deep Learning EngineerAbout Vidurta:Vidurta is an Indo-French startup on a mission to bridge the gaps between India and France byproviding top IT talent from India. Based in France, our proximity helps us understand the needs ofboth French and Indian professionals. We are a young, remote-first company that offers astimulating work...