AWS Data Engineer

3 weeks ago


Kannur, India Webologix Ltd INC Full time

Job Position: AWS Data Engineer

Job Type: Full-Time

Location: Kolkata, IN

Experience: - 4+ to 10+ Years

Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL.


Key Responsibilities:


  • Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to facilitate ETL (Extract, Transform, Load) processes and ensure data integrity and accessibility.
  • Data Storage Management: Utilize Amazon S3 for scalable and secure data storage. Optimize data storage solutions and manage data lifecycle policies to ensure efficient data retrieval and cost management.
  • Data Transformation and Processing: Develop and execute data transformation workflows using AWS Glue and PySpark. Ensure data is processed efficiently and accurately to meet business requirements.
  • Database Management: Manage and optimize relational and NoSQL databases using Amazon RDS and DynamoDB. Implement data models and design schemas to support business applications and reporting needs.
  • Scripting and Automation: Write Python scripts to automate data processing tasks, integrate data from various sources, and develop custom solutions for data manipulation and analysis.
  • SQL and PL/SQL Development: Utilize SQL for querying relational databases and performing complex data manipulations. Apply PL/SQL for advanced database procedures and optimizations in Oracle environments.
  • Data Quality and Performance: Monitor and maintain data quality, performance, and security. Implement best practices for data management and troubleshoot issues to ensure reliable data operations.
  • Collaboration and Documentation: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide technical expertise. Document data pipelines, processes, and architecture to support ongoing maintenance and scalability.


Required Skills and Qualifications:

  • Proven experience as a Data Engineer or similar role with a focus on AWS technologies.
  • Strong proficiency in AWS services including S3, Lambda, Glue, Step Functions, RDS, and DynamoDB.
  • Expertise in Python and PySpark for data processing and automation tasks.
  • Solid experience with SQL and PL/SQL for querying and managing relational databases.
  • Demonstrated ability to design and implement data pipelines and workflows.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration abilities.


Qualifications:

Bachelor’s degree in computer science, Information Technology, or a related field.


  • Data Engineer

    3 weeks ago


    Kannur, India TechEnhance Full time

    Company DescriptionTechEnhance is an Digital Transformation solutions provider based in Bengaluru that specializes in productivity optimization for businesses through the use of artificial intelligence, Cloud, DevOps, app development and custom development. Role DescriptionThis is a full-time hybrid role for a Data Engineer at TechEnhance in...


  • kannur, India Client of Alp Consulting Ltd. Full time

    Client of Alp Consulting which is a 30 years old organization, headquartered in Edison, NJ. They have a global team of ~6400 associates, with engineers in 14 major delivery centers across North America, EMEA, APAC and LATAM.​Work mode: Remote (Can work from Anywhere in India)Qualification: Any graduation (Fulltime & Regular)Experience: 7 to 10 yearsRole:...


  • Kannur, India HARMAN India Full time

    Harman is looking for Cloud solution- AWS and Azure Engineers.Job Location: BangaloreMode: HybridExperience- 7-12YearsJob Description:SummaryWe are seeking a highly motivated and technical Partner Solutions Architect to play a key role in driving successful partnerships with AWS and Azure. You will be responsible for creating innovative solutions leveraging...

  • Data Engineer

    4 weeks ago


    Kannur, India GreenTree Advisory Services Pvt Ltd Full time

    Technical and professional skills: We are looking for a flexible, fast learning, technically strong Data Engineer. Expertise is required in the following fields: Proficient in Cloud Services –SnowflakeBuild ETL and data movement solutions.Migrate data from traditional database systems to Cloud environmentStrong hands-on experience for working with...


  • kannur, India ThreatXIntel Full time

    Company Description ThreatXIntel is a startup cyber security company specializing in protecting businesses and organizations from cyber threats. Our team provides services such as cloud security, web and mobile security testing, and DevSecOps. We focus on delivering customized, affordable solutions to meet the specific needs of our clients, regardless of...


  • kannur, India PURVIEW Full time

    Role: Data Protection Automation Architect Location: Pune or Hyderabad (Hybrid) Job Type: Long Term Contract (Permanent to Purview Services) NOTE: Client is looking for immediate joiners or Minimum 15 Days Notice period Client is looking for 10+ years experience candidates In this role, you will: Design, develop, test, and support automation for the...


  • Kannur, India International Software Systems, Inc. Full time

    Cloud Systems Engineer -Kubernetes Certified Job Responsibilities:• Implement and manage IaaS and PaaS services in cloud platforms. Support/managementscope are for core infrastructure services (servers, elastic load balancers, storage, Lambda functions,RDS, etc…).• OS level support of Linux environments, including troubleshooting, responding to...


  • Kannur, India P:101 Full time

    About Us: We are a dynamic and innovative technology company at the forefront of business communication solutions for the healthcare industry. Our mission is to revolutionize healthcare communications using cutting-edge AI technologies. As we continue to expand our global footprint, we are looking to hire top talent in India to join our team of experts in...

  • Data Scientist

    3 weeks ago


    Kannur, India BLKBOX.ai Full time

    CompanyBlkbox.ai is at the forefront of ad tech innovation, we are transforming the way brands connect with their audience. Our AI-powered platform is revolutionizing digital marketing by identifying and optimizing top-performing ads with unparalleled speed and accuracy. Backed by a team of ex-Meta experts and cutting-edge LLM technology, we're not just...

  • Python Developer

    6 days ago


    kannur, India True Tech Professionals Full time

    Senior Backend Engineer (AWS, Python, Flask/FastAPI)Location: Remote/ Gurgaon (Hybrid) PreferredExperience: 6 to 9 yearsJob Description:We are looking for a highly skilled Senior Backend Engineer with 6 to 9 years of experience in developing and maintaining scalable backend systems using AWS, Python, Flask, FastAPI, and other modern technologies. The ideal...

  • Azure DevOps Engineer

    1 month ago


    Kannur, India System Soft Technologies Full time

    Job Summary:The client is looking for an Azure DevOps Engineer:DevOps Engineer works with developers and the IT team to oversee the code releases. Many-times developers who get interested in deployment and network operations or sysadmins who have a passion for scripting and coding and move into the development side where they can improve the planning of test...


  • kannur, India Avyka Full time

    At Avyka, we are dedicated to transforming your software delivery pipeline through the power of DevOps. We specialize in delivering comprehensive DevOps solutions that automate, secure, and optimize development processes. Our mission is to help clients achieve faster time-to-market, fortified security, and operational excellence.Job Overview:We are seeking a...


  • Kannur, India Finesse Ink Full time

    Overview:We are seeking a talented Senior Full Stack Engineer with a minimum of 4 years of experience to join our team. The ideal candidate will have a strong background in both front-end and back-end technologies, a passion for building robust applications, and the ability to collaborate effectively with cross-functional teams.Key Responsibilities:Design,...


  • kannur, India CES Full time

    Position Overview:As a Backend Engineer, you will be responsible for developing and maintaining the backend infrastructure of the geospatial software solutions. You will work with Geospatial SDKs and APIs, ensuring seamless integration and functionality. Your expertise in ArcGIS, open-source geospatial engineering, Python development, and cloud-based...


  • kannur, India BayOne Solutions Full time

    Position: Senior Cloud/DevOps Engineer Location: Gurugram/Bengaluru(Hybrid) Job Type: Fulltime with BayOne JD: Looking for candidats who can work on one or all of the following: (1) assist in migration of teams from the current deployment settings/tooling into new deployment settings/tooling once those items are available. (2) Update and write Python...

  • Cloud Ops Engineer

    1 month ago


    Kannur, India Mumba Technologies, Inc. Full time

    Job Title: Cloud Ops EngineerJob Type: Full TimeJob Location: 100% RemoteShift Timing: Rotational ShiftReports To: System ManagerSummary: The Cloud Ops Engineer reporting to the System Manager will be part of a talented team of engineers and will be expected to demonstrate superb technical competency in delivering critical infrastructure and ensuring the...


  • kannur, India Adastra Full time

    The Adastra Group is an international IT consulting company with 23 international offices. Adastra provides leading companies with the full range of consulting services in information management - from conception to implementation and application of innovative Data & Analytics solutions. With over 2000+ experts worldwide we bridge the gap between business...


  • Kannur, India apna Full time

    About the roleThe DevOps lead will work closely with SRE & Developer teams to accelerate the delivery of Apna’s growing ecosystem of Microservices. The engineer will understand the current architecture, propose solutions to increase stability, Availability, and Reliability of Apna’s internal and external systems.Work with the Head of Infrastructure and...


  • kannur, India KOTH Gaming Full time

    LocationIndia (Remote) with the potential of UK visa work sponsorship for relocation to HQ in LondonCompensationCompetitive salary with bonus (cash and equity)University RequirementApplicants must have graduated from an IIT (Indian Institute of Technology) institution, ideally in Computer Science, for their undergraduate studies. Unfortunately, due to...


  • kannur, India Dautom Full time

    Client Introduction: In this role, you will have the opportunity to work closely with one of our esteemed clients. This client is a global leader in the IT industry, known for its commitment to quality and innovation. They have chosen Dautom as their trusted partner for their upcoming projects. Job Title: Senior Network Engineer Job Location: Mumbai /...