Senior Data Engineer
3 months ago
System Two Security is looking to hire a Senior Security Data Engineer who is highly skilled and experienced. This role is pivotal in ensuring the integrity and usability of our data. The ideal candidate will have a strong background in data engineering and cyber security, with the ability to work autonomously on critical projects.
Responsibilities
Generate Synthetic data: Build validation data from examples of security data. Combine powerful synthetic data generation with sophisticated coverage analysis to create the smallest set of data needed for comprehensive testing.
Data Validation: Build Validation frameworks for ML models.
Team Collaboration: Partner with data science teams to tailor AI solutions.
Store and reuse existing data: Centrally store data as a reusable asset that can be received in minutes, cloned as it’s provisioned and matched to the exact tests it can run.
Overseeing Data Architecture and Management: design and maintain a scalable and secure data architecture. Handle cybersecurity data, informing AI model development.
Ensuring Data Quality and Integrity: takes the lead in ensuring that data is accurate, consistent, and reliable.
Ensuring Data Security and Privacy: ensuring that data is stored securely, access controls are in place, and data privacy regulations are adhered to.
Work autonomously: little or no supervision on important, time-sensitive, and highly visible assignments.
Industry Awareness: Keep updated with data management, AI, and cybersecurity advancements.
Effective Communication: Convey concepts within the cybersecurity context.
Required Skills
Bachelor‘s or degree in computer science, data engineering, or a related field is essential.
3+ years of experience
Professional experience in data engineering, software development, or database administration.
Knowledge of programming languages such as Python, SQL, and/or Java.
Knowledge in data engineering concepts, including data modeling, database design, ETL (Extract, Transform, Load) processes, and data warehousing.
Familiar with Big Data technologies, cloud platforms, and data visualization tools.
Knowledge of Artificial Intelligence/Machine Learning concepts.
Able to convey complex ideas in a clear and concise manner and bridge the gap between technical and non-technical teams.
Adaptable with the ability to quickly learn new technology.
About the Company: System Two Security is driving SOC transformation with its unique application of AI computing with an initial focus on generative AI powered proactive threat research, threat analysis and iterative threat hunting. The product’s purpose-built language agents respond to new threat actors and attack patterns within minutes with its agentic workflows delivering end-to-end threat detection and containment from integrated feeds of raw cyber threat advisories. Early users of the product include prominent MSSPs, and enterprise SOCs across retail, healthcare, SaaS and technology verticals. It is based in Palo Alto, CA and is venture funded by The Hive.
-
delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
4 weeks ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
4 weeks ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:- Design and architect integration solutions to connect various enterprise applications, systems, and databases.- Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.- Utilize Azure Integration Services such as Azure Logic...
-
Senior data integration engineer
3 weeks ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
delhi, India Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Engineer
3 weeks ago
Delhi, India Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Wavicle Data Solutions | Senior Data Scientist
2 weeks ago
delhi, India Wavicle Data Solutions Full timeJob Title: Senior Data Scientist We are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business...
-
Senior Data Engineer
2 weeks ago
Delhi, India Rakuten Symphony Full timeJob Title: Senior Data Engineer Location: Bangalore, IndiaCompany: Rakuten Symphony, IndiaOverviewRakuten Symphony is seeking an experienced and strategic Head/Senior Data Engineer to lead our data engineering initiatives and transform mobile connectivity through innovative data solutions. This senior leadership role requires deep expertise in...
-
Data Engineer
6 days ago
Delhi, India Pacific Data Integrators Full timeJob OverviewWe are seeking a skilledData Engineerto join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in MS...
-
Data Engineer
7 days ago
Delhi, India Pacific Data Integrators Full timeJob OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...
-
ITI Data | PySpark Data Engineer
1 week ago
delhi, India ITI Data Full timeLocation : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark...
-
Pyspark data engineer
2 weeks ago
Delhi, India ITI Data Full timeLocation : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a Py Spark...
-
PySpark Data Engineer
2 weeks ago
Delhi, India ITI Data Full timeLocation : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark...
-
Senior Data Engineer
7 days ago
Delhi, India Trek Health Full timeCompany DescriptionTrek Health is revolutionizing healthcare with its Payer Price Transparency Analytics Platform. Our solutions offer payer-provider price transparency insights and analytics. We take pride in ingesting and processsing multi-terabytes of data every month and provide actionable insights to our customers. The company is backed by $3M seed...
-
Lead data engineer
1 month ago
Delhi, India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
Data Platform Engineer
2 weeks ago
Delhi, India OSD Data Services Full timeData Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
Data platform engineer
2 weeks ago
Delhi, India OSD Data Services Full timeData Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...
-
Senior Data Engineering Expert
1 day ago
Delhi, Delhi, India Huptech HR Solutions Full timeJob Title: Senior Data Engineering ExpertWe are seeking a highly skilled Senior Data Engineering Expert to join our team at Huptech HR Solutions.
-
Data Platform Engineer
2 weeks ago
Delhi, India OSD Data Services Full timeData Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
AWS Data Engineer
1 month ago
delhi, India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....