Data Engineer
1 month ago
- Create and maintain optimal data pipeline architecture; adopt new technologies to improve existing frameworks of data flow and monitoring
- Assemble large, complex data sets that meet functional / non-functional business requirements
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and ‘big data’ technologies; take necessary steps to implement necessary changes in the IT infrastructure such as MDM tool acquisition, data lake design, cloud solutions implementation in coordination with IT and technology coordinator
- Create data tools for analytics and data scientist team members that assist them in building models by automating and simplifying data preparation
- Translate customer data strategy into actionable data integration plans and execute these plans
- Maintain 360 degree view of customer, enhance the customer datamarts by continuously integrating new sources of data
Data cleansing and unification
- Create automated data anomaly detection systems and constant tracking of its performance
- Process, cleanse, and verify integrity of data used for analysis; active use of built-in data quality dashboard on CDP and coordination of corrective actions
- Develop algorithms to de-duplicate and export customer data from multiple BUs to ensure data unification
- Ensure continuous unification of customer records and associated profile and transactional data
•Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, or related field
•Understanding of data modeling principles
•5+ years of significant configuration and data management experience; comfortable handling and manipulating data, with demonstrated experience in a data-intensive setting
•Experience building highly scalable and high performing databases using modern NoSQL or cloud based technologies and integrating external APIs for data acquisition
•Experience identifying data anomalies or imperfections
•Experience of data structures and schemas, data preparation, cleansing and unification
•Possess the ability to train others – pass on knowledge within the organization
-
Data Engineer
2 weeks ago
Kuwait City Voli_Agency _LTD Full timeCollaborate with our engineering team to tackle complex challenges and deliver impactful solutions.Develop and maintain scalable solutions for handling foundational blockchain datasets.Ensure the security and reliability of our real-time data services, empowering our platform’s growth and scalability.
-
Senior Data Engineer
2 weeks ago
Kuwait City Lynx Analytics Full timeAs a Senior Data Engineer, your responsibility is to implement and deploy data analysis pipelines at various clients of Lynx Analytics. In this role, you willUnderstand the business problems we solve for our client. This role involves frequent communication with our client, and a close working relation with the Data Scientist.Discover the client's...
-
Required Data Engineer
1 month ago
Kuwait City Talent Pal Full timehtmlRequired Data EngineerBachelor degreeMust have completed one of the following certifications: Data Engineering certification Database Administrator certification (Oracle or SQL server) Must have 8 yrs. of Experience in IT Industry with 3 yrs. experience in software development and administering database.Must have 3 yrs. experience as Data...
-
Data Engineer
1 week ago
Kuwait City ESOFT CONSULTING LTD. Full timeAnalyze financial data and reconcile transactions. Contribute to data warehouse design and SQL procedures. Build and manage SAS jobs. Resolve discrepancies in financial data.
-
Senior Data Engineer
1 month ago
Kuwait City Talent Pal Full timeAs a Senior Data Engineer your responsibility is to implement and deploy data analysis pipelines at various clients of Lynx Analytics. In this role you will:Understand the business problems we solve for our clients. This role involves frequent communication with our clients and a close working relationship with the Data Scientist.Discover the clients...
-
Data Engineer btelligent GmbH Co KG
1 month ago
Kuwait City DEVjobs Full timeUtilize your expertise in Google Cloud Platform (GCP) to design, implement, and maintain scalable data pipelinesEnsure high data quality by implementing data pipeline testing and monitoringCollaborate with the team to build and optimize data transformation processes using Dataform, Airflow, and other GCP data engineering toolsWrite clean, efficient Python...
-
Big Data Engineer
1 month ago
Kuwait City AI Staffing Ninja Full timeDesign, develop, and maintain big data infrastructure and data pipelines.Work closely with data scientists and analysts to understand their requirements and translate them into technical solutions.Optimize and tune data pipelines for performance and scalability.Implement data security and privacy measures to protect sensitive information.Troubleshoot and...
-
Data Scientist
1 month ago
Kuwait City Tech Kinect Full timeAnalyze raw data: assessing quality, cleansing, structuring for downstream processingDesign accurate and scalable prediction algorithmsCollaborate with engineering team to bring analytical prototypes to productionGenerate actionable insights for business improvements
-
Azure Data Engineer
1 week ago
Kuwait City Braintrust Full timeCollaborate with architects and stakeholders to understand project requirements and objectives.Develop high-quality Python code to implement data solutions on the Azure platform.Utilize Azure Data Factory for efficient data pipeline orchestration and management.Work with Azure Data Bricks to process and analyze large datasets.Implement and optimize data...
-
Regional Account Manager
1 month ago
Kuwait City S.T.A. DATA srl Full timeThe ideal candidate has sales experience and customer support in structural design software for civil engineering, like engineering companies, professionals and specialized software reselles.They should be skilled at building and maintaining relationships with clients and work to provide the first level of support to the customers.
-
Big Data Analyst
1 month ago
Kuwait City AI Staffing Ninja Full timeData Collection and Processing:Collaborate with data engineers to identify and acquire relevant data from various sources, including databases, data warehouses, APIs, and external datasets.Clean, transform, and preprocess raw data to ensure accuracy, consistency, and compatibility for analysis. Data Analysis and Interpretation:Apply statistical techniques,...
-
Data Engineer btelligent GmbH Co KG
1 month ago
Kuwait City Talent Pal Full timeUtilize your expertise in Google Cloud Platform (GCP) to design implement and maintain scalable data pipelines Ensure high data quality by implementing data pipeline testing and monitoring Collaborate with the team to build and optimize data transformation processes using Dataform Airflow and other GCP data engineering tools Write clean efficient Python...
-
Data Engineer
1 month ago
Kuwait City BRUNEL Full timeAssume responsibility for the proper management of the mud-logging unit, including crew, equipment and operations.Understand and monitor all well site operations.Ensure that all equipment are functioning properly. Perform regular and frequent calibration checks of instruments and routine maintenance is performed as required on all equipment, particularly...
-
Sr Data Engineer
3 weeks ago
Kuwait City PrecisionHire Solutions Full timeDesign, develop, test, and deploy data integration solutions based on business requirementsCollaborate with team members on data integration designs and alternativesTroubleshoot and resolve production issues
-
Sr Data Engineer
1 month ago
Kuwait City Talent Pal Full timeJob SummaryOversee and manage various aspects of data integration and data warehouse processes. This includes implementing data quality measures designing and deploying integration solutions collaborating with team members troubleshooting production issues refining best practices educating end users participating in code reviews exploring and adopting new...
-
Data Security Engineer BigID
2 weeks ago
Kuwait City Braintrust Full timeDesign, implement, and manage security measures and data protection strategies using BigID data discovery and classification tools, as well as relational database technologies and data analytic tools.Lead the development and enforcement of data governance policies and procedures to ensure compliance with GDPR, CCPA, PCI-DSS, and other relevant data...
-
Data Scientist
1 month ago
Kuwait City Talent Pal Full timeAnalyze raw data : assessing quality cleansing structuring for downstream processingDesign accurate and scalable prediction algorithmsCollaborate with engineering team to bring analytical prototypes to productionGenerate actionable insights for business improvementsThis job has been sourced from an external job board.More jobs on
-
QA Automation Data streaming
2 weeks ago
Kuwait City Quadcode Full timeWe are seeking an Automation Quality Assurance Engineer to join our Data Streaming team. Our team develops and maintains analytics services for near real-time processing of user trading activity on the platform, as well as several infrastructure services. We use Scala, ZIO, Kafka, and Postgres, microservice architecture, and event sourcing. The tasks we...
-
Subgraph Data Review Quality Assurance QA
2 weeks ago
Kuwait City Braintrust Full timeAs a Subgraph Data Review & QA Specialist, you will be tasked with the critical role of reviewing and validating the data within subgraphs to ensure it meets the specified requirements and quality standards. You will work closely with data engineers and developers to identify, analyze, and resolve data inconsistencies and to maintain the highest level of...
-
Data Analyst
1 month ago
Kuwait City Talent Pal Full timeUsing automated tools to extract data from primary and secondary sourcesRemoving corrupted data and fixing coding errors and related problemsDeveloping and maintaining databases and data systems reorganizing data in a readable formatPerforming analysis to assess the quality and meaning of dataFilter Data by reviewing reports and performance indicators to...