Senior Data Engineer

1 month ago

Ahmedabad, India Cygnet Infotech Full time
Experience:- 4 to 8 years
Description:
Build, maintain, and support large-scale collections and processing systems.
Be part of a Scrum team that designs, swarms, and pairs together
Implement and improve deployment, monitoring, testing, operational and foundational tools.
Be an excellent problem solver and be willing to roll up sleeves to tackle any issue thrown your way
Experience We Want to See:
Some hands on experience with large-scale distributed systems
S. or higher in Computer Science or equivalent training and experience
Familiarity with one or more of the public clouds like AWS, GCP or Azure.
Familiarity with Python, Java, Spark, Ruby and/or Node.js
Experience with source control. Github is preferred.
Experience with Linux and cloud-based environments
Familiarity with Infrastructure as Code such as Terraform or CloudFormation
Ability to communicate with management, software architects, and developers about project status, APIs and overall systemhealth.
Working knowledge of modern web technologies including cloud based APIs and protocols (REST, JSON)
Nice to Have:
Data Science background or experience
Amazon Web Services (AWS) experience with EC2, ECS and S3
Infrastructure as code provisioning tools such as Terraform/CloudFormation, etc.
Participation in a technical community is a major plus: e.g., contributions to open-source projects, published works, presentations in academic conferences or industry circles
AWS networking such as VPC and security groups
AWS Analytics such as Athena, Glue, Sagemaker, Kinesis
Here is what you will be working with
Python
js ES6
Ruby
Java, Scala
HBase/EMR clusters, Riak, Redis/Elasticache, MySQL
AWS Services
Thousands of servers

  • AWS Data Engineer/Senior Engineer

    2 months ago

    Ahmedabad, Gujarat, India Arrow Electronics Full time

    Position:AWS Data Engineer/Senior EngineerJob Description:Responsibilities: Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda,...

  • AWS Data Engineer/Senior Engineer

    8 hours ago

    Ahmedabad, Gujarat, India Arrow Electronics Full time

    Position:AWS Data Engineer/Senior EngineerJob Description:Responsibilities: Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda,...

  • AWS Data Engineer/Senior Engineer

    2 months ago

    Ahmedabad, India Arrow Electronics Full time

    Position:AWS Data Engineer/Senior EngineerJob Description:Responsibilities: Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3,...

  • AWS Data Engineer/Senior Engineer

    7 hours ago

    Ahmedabad, India Arrow Electronics Full time

    Position:AWS Data Engineer/Senior EngineerJob Description:Responsibilities: Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3,...

  • Senior Business Operations Executive

    3 weeks ago

    ahmedabad, India Crest Data Full time

    Key Skills :2-6 years of hands-on business operations experience within IT domain.Excellent Oral and written communication skills.Excellent presentation skillsDegree in Science or EngineeringExcellent knowledge of MS Excel, Word and PowerPointMust be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the...

  • Senior Financial Analyst

    7 days ago

    Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL : Senior Financial AnalystExperience: 3+...

  • Senior Financial Analyst

    2 weeks ago

    Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data Systems is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL :Role: Senior Financial...

  • Senior Financial Analyst

    1 week ago

    Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL :Role: Senior Financial AnalystExperience:...

  • Senior Financial Analyst

    2 weeks ago

    ahmedabad, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL : Senior Financial AnalystExperience: 3+...

  • Senior Data Engineer

    1 week ago

    Ahmedabad, India VOLANSYS (An ACL Digital Company) Full time

    Technical Skills:Bachelor's degree in Computer Science, Engineering, or related field.Proficiency in Python programming language and its data manipulation libraries (Pandas, NumPy).Experience with Apache Spark (PySpark) for large-scale data processing.Knowledge of Apache Airflow for workflow automation.Strong SQL skills for data querying and...

  • Senior Data Engineer

    2 weeks ago

    Ahmedabad, India VOLANSYS (An ACL Digital Company) Full time

    Technical Skills:Bachelor's degree in Computer Science, Engineering, or related field.Proficiency in Python programming language and its data manipulation libraries (Pandas, NumPy).Experience with Apache Spark (PySpark) for large-scale data processing.Knowledge of Apache Airflow for workflow automation.Strong SQL skills for data querying and...

  • Senior Business Operations Executive

    3 weeks ago

    ahmedabad, India Crest Data Full time

    Key Skills : 2-6 years of hands-on business operations experience within IT domain. Excellent Oral and written communication skills. Excellent presentation skills Degree in Science or Engineering Excellent knowledge of MS Excel, Word and PowerPoint Must be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the...

  • Senior Business Operations Executive

    3 weeks ago

    Ahmedabad, India Crest Data Full time

    Key Skills:2-6 years of hands-on business operations experience within IT domain.Excellent Oral and written communication skills.Excellent presentation skillsDegree in Science or EngineeringExcellent knowledge of MS Excel, Word and PowerPointMust be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the capacity...

  • Senior Business Operations Executive

    3 weeks ago

    Ahmedabad, India Crest Data Full time

    Key Skills:2-6 years of hands-on business operations experience within IT domain.Excellent Oral and written communication skills.Excellent presentation skillsDegree in Science or EngineeringExcellent knowledge of MS Excel, Word and PowerPointMust be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the capacity...

  • MS Senior Engineer Patch Management

    1 week ago

    Ahmedabad, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • MS Senior Engineer Patch Management

    1 week ago

    ahmedabad, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help...

  • AWS Data Engineer/Senior Engineer

    1 month ago

    Ahmedabad, India Arrow Electronics Full time

    Description:Responsibilities:Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena, and RedShift.Implement data...

  • Senior Business Operations Executive

    5 days ago

    Ahmedabad, India Crest Data Full time

    Key Skills:4+ years of hands-on business operations experience within IT domain.Excellent Oral and written communication skills.Excellent presentation skillsDegree in Science or EngineeringExcellent knowledge of MS Excel, Word and PowerPointMust be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the capacity...

  • Senior Business Operations Executive

    6 days ago

    Ahmedabad, India Crest Data Full time

    Key Skills:4+ years of hands-on business operations experience within IT domain.Excellent Oral and written communication skills.Excellent presentation skillsDegree in Science or EngineeringExcellent knowledge of MS Excel, Word and PowerPointMust be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the capacity...

  • Senior Data Engineer

    3 weeks ago

    Ahmedabad, India Ridgeant Techonologies Full time

    Job Description : AWS Data EngineerResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena,...