Senior Data Engineer

2 months ago


Ahmedabad, India Cygnet Infotech Full time

Experience:- 4 to 8 years

Description:

Build, maintain, and support large-scale collections and processing systems.Be part of a Scrum team that designs, swarms, and pairs togetherImplement and improve deployment, monitoring, testing, operational and foundational tools.Be an excellent problem solver and be willing to roll up sleeves to tackle any issue thrown your way

Experience We Want to See:

Some hands on experience with large-scale distributed systemsS. or higher in Computer Science or equivalent training and experienceFamiliarity with one or more of the public clouds like AWS, GCP or Azure.Familiarity with Python, Java, Spark, Ruby and/or Node.jsExperience with source control. Github is preferred.Experience with Linux and cloud-based environmentsFamiliarity with Infrastructure as Code such as Terraform or CloudFormationAbility to communicate with management, software architects, and developers about project status, APIs and overall systemhealth.Working knowledge of modern web technologies including cloud based APIs and protocols (REST, JSON)

Nice to Have:

Data Science background or experienceAmazon Web Services (AWS) experience with EC2, ECS and S3Infrastructure as code provisioning tools such as Terraform/CloudFormation, etc.Participation in a technical community is a major plus: e.g., contributions to open-source projects, published works, presentations in academic conferences or industry circlesAWS networking such as VPC and security groupsAWS Analytics such as Athena, Glue, Sagemaker, KinesisHere is what you will be working withPythonjs ES6RubyJava, ScalaHBase/EMR clusters, Riak, Redis/Elasticache, MySQLAWS ServicesThousands of servers

  • Ahmedabad, Gujarat, India Arrow Electronics Full time

    Position:AWS Data Engineer/Senior EngineerJob Description:Responsibilities: Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda,...


  • Ahmedabad, India Arrow Electronics Full time

    Position:AWS Data Engineer/Senior EngineerJob Description:Responsibilities: Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3,...


  • ahmedabad, India Crest Data Full time

    Key Skills :2-6 years of hands-on business operations experience within IT domain.Excellent Oral and written communication skills.Excellent presentation skillsDegree in Science or EngineeringExcellent knowledge of MS Excel, Word and PowerPointMust be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the...


  • Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL : Senior Financial AnalystExperience: 3+...


  • Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data Systems is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL :Role: Senior Financial...


  • Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL :Role: Senior Financial AnalystExperience:...


  • ahmedabad, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL : Senior Financial AnalystExperience: 3+...


  • Ahmedabad, India Crest Data Full time

    Key Skills:2-6 years of hands-on business operations experience within IT domain.Excellent Oral and written communication skills.Excellent presentation skillsDegree in Science or EngineeringExcellent knowledge of MS Excel, Word and PowerPointMust be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the capacity...


  • ahmedabad, India Crest Data Full time

    Key Skills : 2-6 years of hands-on business operations experience within IT domain. Excellent Oral and written communication skills. Excellent presentation skills Degree in Science or Engineering Excellent knowledge of MS Excel, Word and PowerPoint Must be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the...


  • Ahmedabad, India Crest Data Full time

    Key Skills:2-6 years of hands-on business operations experience within IT domain.Excellent Oral and written communication skills.Excellent presentation skillsDegree in Science or EngineeringExcellent knowledge of MS Excel, Word and PowerPointMust be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the capacity...


  • Ahmedabad, India VOLANSYS (An ACL Digital Company) Full time

    Technical Skills:Bachelor's degree in Computer Science, Engineering, or related field.Proficiency in Python programming language and its data manipulation libraries (Pandas, NumPy).Experience with Apache Spark (PySpark) for large-scale data processing.Knowledge of Apache Airflow for workflow automation.Strong SQL skills for data querying and...


  • Ahmedabad, India VOLANSYS (An ACL Digital Company) Full time

    Technical Skills:Bachelor's degree in Computer Science, Engineering, or related field.Proficiency in Python programming language and its data manipulation libraries (Pandas, NumPy).Experience with Apache Spark (PySpark) for large-scale data processing.Knowledge of Apache Airflow for workflow automation.Strong SQL skills for data querying and...


  • Ahmedabad, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...


  • ahmedabad, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help...


  • Ahmedabad, India Crest Data Full time

    Key Skills:4+ years of hands-on business operations experience within IT domain.Excellent Oral and written communication skills.Excellent presentation skillsDegree in Science or EngineeringExcellent knowledge of MS Excel, Word and PowerPointMust be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the capacity...


  • Ahmedabad, India Crest Data Full time

    Key Skills:4+ years of hands-on business operations experience within IT domain.Excellent Oral and written communication skills.Excellent presentation skillsDegree in Science or EngineeringExcellent knowledge of MS Excel, Word and PowerPointMust be self-motivated, a natural problem solver, and able to follow the process proactively, as well as the capacity...


  • Ahmedabad, India Arrow Electronics Full time

    Description:Responsibilities:Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena, and RedShift.Implement data...

  • Senior Data Engineer

    2 weeks ago


    Ahmedabad, India Ridgeant Techonologies Full time

    Job Description : AWS Data EngineerResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena,...

  • Senior Data Engineer

    2 weeks ago


    Ahmedabad, India Ridgeant Techonologies Full time

    Job Description : AWS Data EngineerResponsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as Glue, S3, Lambda, DynamoDB, Athena,...

  • Lead DevOps Engineer

    4 weeks ago


    ahmedabad, India Crest Data Full time

    Company Overview:Crest Data Systems is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon...