AWS Data Engineer
3 months ago
Job Position: AWS Data Engineer
Job Type: Full-Time
Location: Kolkata, IN
Experience: - 4+ to 10+ Years
Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL.
Key Responsibilities:
- Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to facilitate ETL (Extract, Transform, Load) processes and ensure data integrity and accessibility.
- Data Storage Management: Utilize Amazon S3 for scalable and secure data storage. Optimize data storage solutions and manage data lifecycle policies to ensure efficient data retrieval and cost management.
- Data Transformation and Processing: Develop and execute data transformation workflows using AWS Glue and PySpark. Ensure data is processed efficiently and accurately to meet business requirements.
- Database Management: Manage and optimize relational and NoSQL databases using Amazon RDS and DynamoDB. Implement data models and design schemas to support business applications and reporting needs.
- Scripting and Automation: Write Python scripts to automate data processing tasks, integrate data from various sources, and develop custom solutions for data manipulation and analysis.
- SQL and PL/SQL Development: Utilize SQL for querying relational databases and performing complex data manipulations. Apply PL/SQL for advanced database procedures and optimizations in Oracle environments.
- Data Quality and Performance: Monitor and maintain data quality, performance, and security. Implement best practices for data management and troubleshoot issues to ensure reliable data operations.
- Collaboration and Documentation: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide technical expertise. Document data pipelines, processes, and architecture to support ongoing maintenance and scalability.
Required Skills and Qualifications:
- Proven experience as a Data Engineer or similar role with a focus on AWS technologies.
- Strong proficiency in AWS services including S3, Lambda, Glue, Step Functions, RDS, and DynamoDB.
- Expertise in Python and PySpark for data processing and automation tasks.
- Solid experience with SQL and PL/SQL for querying and managing relational databases.
- Demonstrated ability to design and implement data pipelines and workflows.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration abilities.
Qualifications:
Bachelor’s degree in computer science, Information Technology, or a related field.
-
Data Infrastructure Specialist
2 weeks ago
Kannur, Kerala, India Sourcebae Full timeWe are seeking an experienced Data Engineer to join our team at Sourcebae. As a Data Engineer, you will play a key role in designing, implementing, and maintaining data pipeline infrastructure on cloud platforms.About the RoleThe ideal candidate will have 5+ years of experience working with public cloud platforms such as AWS, Azure, or GCP. You will be...
-
Head of Data Engineering
6 days ago
Kannur, India PriceEasy AI Full timeAbout PriceEasy:Join one of the most respected and cutting-edge companies in the pricing and analytics industry! PriceEasy, a VC-backed leader, empowers convenience retailers with actionable insights through advanced technologies. With a robust, innovative platform trusted by top companies globally, we are at the forefront of revolutionizing how businesses...
-
Senior Data Engineer- Azure
2 months ago
Kannur, India Azilen Technologies Full timeJob purpose:Design & implement the best-engineered technical solutions using the latest technologies and tools.Who you are:4+ Experience in designing and hands-on development in cloud-based analytics solutions.Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required.Designing and building...
-
Data Analysis Engineer
3 days ago
Kannur, Kerala, India Luxoft Full timeAbout the RoleThe successful Data Analysis Engineer will contribute to the design, development, and implementation of business intelligence solutions using microservices cloud-based architecture. This is an excellent opportunity to scale technical skills and contribute to business growth.
-
Data Solutions Architect
2 months ago
kannur, India Dexian India Full timeLocation - Chennai (Onsite working model)We are seeking an experienced Data Solutions Architect skilled in presales and hands-on implementation, with a strong focus on data architecture, data warehousing, data analytics, and data modeling.Key Responsibilities:Presales and Solutioning:Collaborate with the sales team to engage with prospective clients,...
-
Sr Consultant Data Engineer Personalization
1 week ago
Kannur, India Visa Full timeData Engineer, Sr Consultant, PersonalizationBangalore, IndiaFull-timeCompany DescriptionVisa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the...
-
Senior Data Engineer
3 days ago
Kannur, Kerala, India Luxoft Full timeAt Luxoft, we are seeking a highly skilled Senior Data Engineer to join our team. This is an excellent opportunity to work on a greenfield project using the latest technologies in microservices cloud-based architecture.The role offers a chance to scale technical skills, including certification, and contribute own knowledge to business growth. Our Company...
-
Backend Software Engineer
3 weeks ago
Kannur, Kerala, India TheRecAI Full timeWe are seeking a skilled Backend Software Engineer at TheRecAI in Pune. This role involves designing and developing scalable server-side applications using NestJS and TypeScript.Key Responsibilities:Backend Development: Build and maintain scalable backend services, implement RESTful APIs, GraphQL, and microservices architectures, and write reusable,...
-
Data Engineer
3 days ago
Kannur, Kerala, India Luxoft Full timeAbout the RoleLuxoft is seeking a skilled Data Engineer to join our Asset Management team. As a key member of our scrum team, you will be responsible for designing and developing business intelligence solutions to support our dynamic business needs.With 5+ years of experience in building BI solutions and 3+ years of expertise in Tableau, you will play a...
-
DevOps Engineer
1 week ago
Kannur, India Snap Pe Full timeCompany DescriptionSnap Pe provides a 360-degree Personalised Omni Channel marketing campaigns and CRM for B2B go-to-market, enabling business owners and stakeholders to conduct business operations on WhatsApp. The company is located in Bengaluru, India.Role DescriptionThis is a full-time on-site role for a DevOps Engineer at Snap Pe in Bengaluru. The DevOps...
-
Data Engineer
3 days ago
Kannur, Kerala, India Luxoft Full timeJob DescriptionLuxoft is seeking a skilled Data Engineer to join our team in developing Business Intelligence solutions. This role offers an exciting opportunity to contribute to the growth of our company and advance your technical skills.The successful candidate will be responsible for supporting the design of Business Intelligence solutions, planning...
-
Site Reliability Engineering Manager
1 week ago
Kannur, India Phonon Communications Pvt Ltd Full timeJob Title: Site Reliability Manager (AWS Cloud)Company: Phonon Communications Private LimitedLocation: Vadodara, Gujarat, IndiaAbout Us:Phonon is a dynamic technology company specializing in communication and customer interaction solutions. We are seeking a Site Reliability Manager (AWS Cloud) to lead our efforts in optimizing cloud infrastructure, ensuring...
-
Backend Engineer
1 week ago
Kannur, Kerala, India Neuron7 Full timeCompany OverviewAt Neuron7.ai, we're redefining service intelligence by leveraging AI-driven technology. Our platform delivers real-time predictions and insights that empower enterprises to make informed decisions. Estimated Salary: $120,000/yearJob DescriptionWe're seeking a highly skilled Backend Engineer to lead the design, development, and maintenance of...
-
Data Scientist
1 month ago
Kannur, India BLJ Tech Geeks Full timeLocation: Gurugram and BengaluruWork Mode: 5 Days (WFO)Requirements:• 3+ years of industry experience in taking research prototypes to production.• Strong expertise in data analytics and interpretation skills.• Proven ability to design analytical solutions to complex business problems and to partner with cross-functional peers to tailor those solutions...
-
Software Engineer
3 weeks ago
Kannur, Kerala, India Innova ESI Full timeAbout Innova ESIWe are a dynamic company that combines innovative technologies and expertise to deliver cutting-edge solutions. Our mission is to empower businesses through technology, and our culture fosters creativity, collaboration, and growth.Job SummaryThe Software Engineer - Cloud Solutions will play a vital role in designing, developing, and deploying...
-
Senior Software Engineer
6 days ago
Kannur, India Talent Sutra Full timeWe are venturing into a high-growth phase and looking for new members to join our startup. Weare hiring a Senior Software Engineer who will contribute by designing, developing, and maintaining cloud applications and services to meet our business needs.Qualification1. Experience working within DevOps ecosystems(Designing and configuring CI/CD pipelines,...
-
DevOps Engineer
3 weeks ago
Kannur, India InfoVision Inc. Full timeJob Description: DevOps EngineerPosition OverviewWe are seeking a highly skilled and motivated DevOps Engineer to join our dynamic team. The successful candidate will be responsible for the deployment and management of mobile applications developed with Flutter, as well as web applications developed with React and Next.js. The deployments will be hosted on...
-
Software Engineer for Enterprise Solutions
3 weeks ago
Kannur, Kerala, India Luxoft Full timeJob Title: Software Engineer for Enterprise SolutionsAbout Us:Luxoft is a global technology company that offers innovative software development and consulting services to clients across various industries.Salary: $120,000 - $180,000 per annum, depending on experience and qualifications.About the Job:We are seeking an experienced Senior Full Stack Engineer to...
-
MLOPs Architect
2 weeks ago
Kannur, India LTIMindtree Full timeMode of Employment: Permanent / FTEWorkplace Type: HybridLocation: all LTIMindtree Location (Pune, Mumbai, Bangalore, Chennai, Hyderabad, Kolkata, Noida)We are looking for people who has Industrial AI background. Industrial AI – Manufacturing Real time AI case solved, Oil and Gas Real time case solved. The person should have sound background on ML Ops life...
-
Specialist - Data Science
1 month ago
Kannur, India Marsh McLennan Full timeWe are seeking a talented individual to join our Data Science team at Marsh. This role will be based in Mumbai. This is a hybrid role that has a requirement of working at least three days a week in the officeWe will count on you to:Data Science:Assembling large, complex sets of data Identifying, implementing internal process improvements including optimizing...