Staff Data Engineer

4 weeks ago


moradabad, India Summit Consulting Services Full time

About the role:

The Staff Data Engineer will architect, build, and maintain data lake and data warehousing solutions for a B2B multi-tenant SaaS solution. Position requires a demonstrated ability to design processes from end to end and a strong technical understanding of modern data pipelines and strategies. In depth knowledge of multiple data sources, data design patterns, ETL transformation, SQL and performance tuning are required. Ability to train and mentor team members and collaborate with cross functional team members.


Role and Responsibilities:

  • Participate in the entire data pipeline lifecycle, focusing on building data lakes, data warehouses and related processes
  • Contribute to the design and documentation of our data lake platform
  • Partner with Sr staff on the development and maintenance of data governance policies and procedures that ensure data quality, accuracy, consistency, and privacy.
  • Mentor other data engineers, providing technical guidance, and ensuring that team members have the necessary skills and resources to perform their duties.
  • Conduct code and design reviews with junior and peer developers
  • Write clean code to develop data pipelines and necessary infrastructure as code
  • Aid in setting coding standards for team members to follow
  • Partner with cross functional teams to understand requirements and effectively design appropriate solutions.
  • Monitor and troubleshoot performance, scalability, and security issues, making improvements as needed
  • Aid in determining and implementing KPI’s for performance and stability of platform
  • Participate in the review of new technologies and tools for our data teams
  • Partner with engineering and other cross functional teams to collect and implement technical and design requirements
  • Communicate effectively with technical and non-technical team members to ensure alignment and successful execution of projects.
  • Participate in cross-functional initiatives, promoting a culture of data-driven decision-making and continuous improvement.
  • Participate in an on call rotation.


Job Requirement :

  • 8 years of related experience; or 6 years and an advanced degree
  • Bachelor’s degree in engineering, computer science, math, data engineering or another related field or equivalent work experience
  • Experience in the development of modern data architecture, analytics, data governance, AI/ML, or related areas.
  • Strong Experience with AWS big data technologies including EMR, Glue, S3, EKS, Lambda, Athena, RDS, MKS/Kafka/Kinesis
  • Expertise with relational and NoSQL databases such as PostgresQL, Cassandra, DynamoDB, MongoDb etc and data modeling principles
  • Knowledge of data pipeline tools and workflow engines, e.g. Apache Airflow and Spark.
  • Experience with DevOps, including CI/CD pipelines, containerized deployment/Kubernetes, and infrastructure-as-code/AWS Cloud Formation/Terraform.
  • Successfully contributes to the entire development lifecycle of teams products
  • Exposure to secure coding practices, access controls, authentication, and audit. AWS Lake formation preferred.
  • Strong experience with SQL (SQL Server, Postgres) and Python, Scala
  • Identify opportunities for process improvement as well as efficiency in solutions
  • Demonstrated ability to mentor junior team members
  • Excellent analytical and time management skills, with a proven ability to deliver value independently
  • Strong written and verbal communication skills, with demonstrated experience providing technical input to technical and non-technical stakeholders
  • Ability to participate in on-call rotation


Preferred:

FinTech industry experience

Understanding of MPP Data Warehouse (Redshift, Greenplum)

Experience with Graph database



  • Moradabad, India Data Unveil Full time

    About us: At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the client’s vision and drive business success. Position Title: QA...

  • Data Engineer

    1 month ago


    Moradabad, India Henson Group Full time

    Job Title: Data EngineerDepartment: Customer IntelligencePosition Type: Full- TimeLocation: Remote - IndiaWorking Hours: Rotational US ShiftsCompany Overview:Henson Group is an award-winning Azure Expert Managed Service solutions company focused on selling and deploying Microsoft technologies for U.S. and international companies. For over 20 years, Microsoft...


  • Moradabad, India Coinbase Full time

    At Coinbase, our mission is to increase economic freedom around the world, and we couldn’t do this without hiring the best people. We’re a group of hard-working overachievers who are deeply focused on building the future of finance and Web3 for our users across the globe, whether they’re trading, storing, staking or using crypto. Know those people who...


  • Moradabad, India HTC Global Services Full time

    8+ years of experience in IT Industry b. 5+ years of experience with Azure Data Engineering Stack (Data Factory, Databricks, Synapse, Event Hub, Cosmos DB, ADLS Gen2, Function app)c. 3+ years of experience with Python / Pysparkd. Good understanding of other Azure servicese. Excellent knowledge of SQLf. Good understanding of Data Warehouse Architecture, Data...

  • Data Entry Specialist

    5 months ago


    Moradabad, India Anarus Full time

    Working with Excel spread sheets to analyze, research, organize and map data.ResponsibilitiesWork with supervisor to understand client requirements for researching, organizing and mapping data from Microsoft Excel Spread sheets.QualificationsStrong skills with Microsoft Excel, PDF and searching on the Internet search engines for information.

  • Data Scientist

    6 months ago


    Moradabad, India bluCognition Full time

    About bluCognition: bluCognition is an AI/ML based start-up specializing in risk analytics, data conversion and data enrichment capabilities. Founded in 2017, by some very named senior professionals from the financial services industry, the company is headquartered in the US, with the delivery center based in Pune. We build all our solutions while leveraging...


  • Moradabad, India Insight Global Full time

    Required Skills10+ years experience Design, implement, and optimize machine learning algorithms and models using open source machine learning frameworks (Tensorflow, PyTorch, XGBoost) Ability to translate functionality into scalable, tested, and configurable platform architecture and softwareEstablish strong software engineering principles for development in...

  • Sr. Data Architect

    1 month ago


    Moradabad, India The Edge Partnership - The Edge in Asia Full time

    Our client is a US headquartered IT firm which specializes in cloud computing solutions, serving clients in life sciences, healthcare, and other regulated sectors. It focuses on cloud transformation, enabling organizations to leverage AWS Cloud for high-performance computing and scalable infrastructure. Key services include cloud migration, data and...


  • moradabad, India Mulya Technologies Full time

    Staff / Senior Digital Design Engineer Bangalore Who We Are We are a AI semiconductor startup company headquartered in Ann Arbor, Michigan, with branches in Bangalore, India and Taiwan. We develop highly scalable and innovative AI accelerator chips that offer high performance, low energy, and customer ease of implementation for embedded Edge AI...


  • Moradabad, India Insight Global Full time

    Required Skills & Experience- 6+ years of experience in machine learning engineering with ½ of the time being within DevOps environment- Proven experience in deploying and managing ML models in production environments using Kubernetes- Strong programming skills in Python, with experience in ML libraries such as TensorFlow, PyTorch, or scikit-learn-...


  • Moradabad, India Deep Dive Consulting Full time

    Job Title: AI and Data Science InternLocation: [Bengaluru/Remote/Both]Company: Deep Dive Consulting Pvt LtdDuration: [2-3 months]About Us:Deep Dive Consulting is a Bangalore-based startup specializing in cutting-edge artificial intelligence and data science solutions. We empower businesses across industries with innovative, tailored AI strategies to address...


  • moradabad, India krtrimaIQ Cognitive Solutions Full time

    Job Title: Azure Databricks EngineerLocation: BangaloreExperience Level: 5+ years of relevant experienceEmployment Type: Full-TimeAbout Us:Join our team to help shape the future of data solutions! We are looking for a skilled Azure Data Engineer to work on cutting-edge projects, transforming large-scale data and enabling data-driven insights for our clients....

  • DevOps Engineer

    3 weeks ago


    Moradabad, India ALLSTARSIT Full time

    Type of Contract: Contractor (B2B), Project Work (3 months)About the CompanyEstablished in 2004, ALLSTARSIT was founded with a clear vision: to enhance the landscape of global IT employment by bridging the gap between companies and skilled professionals. The core belief was that geographical constraints shouldn't hinder assembling a team. Fast forward to the...


  • Moradabad, India Larsen & Toubro Full time

    L&T’s Power Transmission & Distribution IC is a leading EPC player in the field of power transmission, distribution. PT&D offers integrated solutions and end-to-end services ranging from design, manufacture, supply, installation and commissioning of Transmission Lines, Substations, Underground Cable Networks, Distribution Networks, Power Quality...


  • moradabad, India ALLSTARSIT Full time

    Type of Contract: Contractor (B2B), Project Work (3 months)About the CompanyEstablished in 2004, ALLSTARSIT was founded with a clear vision: to enhance the landscape of global IT employment by bridging the gap between companies and skilled professionals. The core belief was that geographical constraints shouldn't hinder assembling a team. Fast forward to the...

  • OrbiTouch HR

    3 weeks ago


    moradabad, India OrbiTouch HR (orbiTouch outsourcing pvt ltd) Full time

    Urgent Hiring || Manager –Surveillance Business || BangaloreProfile- Manager –Surveillance BusinessExperience- Min 8 yearsCtc- Upto 7.2 Lpa (Depend on the interview)Location- BengaluruJob responsibilities of Manager –Surveillance Business:Overall responsible for providing the service support for the Surveillance Business of the companySupervise and...

  • Associate QA Engineer

    1 month ago


    Moradabad, India e2open Full time

    Title: Associate QA EngineerExperience: 1.5 years to 3 yearsLocation: BengaluruAt E2open, you will be an integral member of a dynamic organization, working on cutting-edge technology that transforms the way companies do business with their trading partners in complex, multi-tier supply chains. Currently, E2open is seeking an energetic Software QA Engineer to...


  • Moradabad, India TSG beverages Full time

    **Greeting and Welcoming Visitors**: Welcome guests and visitors in a professional and friendly manner. Provide information and assistance to guests upon arrival. **Client Service**:Assist customers, clients, or visitors with inquiries and requests. Handle and resolve complaints or escalate them to the appropriate department. **Appointment...

  • Instrument Engineer

    4 weeks ago


    Moradabad, India TEKsystems Full time

    Experience Level: 3 to 8 yearsJob Summary:Job Title: Labview and Teststand DeveloperJob DetailWork with key stakeholders like Digital Product Owner, Solutions Architect and Product Development Team to design, develop, deliver, deploy, and support products in OT & Automation product portfolio.Work on understanding requirements, apply system development...

  • Founder Principal

    2 months ago


    Moradabad, India Seth M. R. Jaipuria Schools Full time

    About the role :The School Principal is responsible for providing leadership, direction, and oversight to ensure the effective operation and success of the school. This role involves managing faculty and staff, maintaining a safe and nurturing learning environment, fostering academic excellence, and collaborating with stakeholders to achieve educational...