Data QA Engineer
We are looking for a detail-oriented engineer with strong SQL and Data management experience to work with our analytics and data science back-end. This role will include verifying data integrity, deduplication, aggregated metrics. Building QA and validation processes for datasets and algorithms. The ideal candidate will have the ability to take ownership of daily data ingests from client and help building validation around it. Collaborate with the data science and ops teams.
Requirements
Strong SQL, MySQL or PostgreSQL
Experience writing scripts in Python
Should be comfortable working with big datasets
Experience validating data in text or CSV data formats
Attention to details and self organization
Nice to have
Experience with AWS S3
Background in science or engineering
Experience with a scheduler such as AirFlow or Jenkins
Big Data technologies: Redshift, Redshift Spectrum, Spark, Hadoop
Workload: Half-time or Full-time
-
1 day156 USD
806 23 0 1 day156 USD
jnkjhjhghjbjhbhgfhghjbfty jbjbkjbuigyugubjhbvuyftygyubuihbiubiuhb
-
30 days446 USD
499 32 1 30 days446 USD
Hi. I have 4 years experience in testing. In general I perform manual testing. Also I can write UI automation tests with selenide, java, maven gitlab CI.
All details in personal messages.
-
Experience with MSSQL, over 10 years. Big bases more than 2Gb, import export csv. Query optimization.
-
MySQL or Postgres? Python?
-
Current freelance projects in the category Data Parsing
Collection of links to sources with rental housing listings
Collection of links to sources with rental housing advertisements It is necessary to compile a database of links to groups, channels, forums, and platforms where rental housing advertisements are published in major cities of Europe and the USA. Goal: to find sources where… Data Parsing, Lead Generation & Sales ∙ 6 hours 35 minutes back ∙ 14 proposals |
Set up the module "Automatic Price List Processing. v.9.5".The store on OcStore 2.3 has the module "Automatic Price List Processing. v.9.5" installed. Everything is set up by the module author, but there are currently some configuration issues that I cannot figure out and understand the logic of the module's operation. For example,… Online Stores & E-commerce, Data Parsing ∙ 1 day 2 hours back ∙ 21 proposals |
Pricing of auto parts from suppliers for auto parts websites based on Prom.Technical task Project Configuration of filling and synchronization of two Prom.ua stores with suppliers of auto parts. Task It is necessary to implement the loading and updating of products from auto parts suppliers for two online stores on Prom.ua. ⸻ 1. Connecting… Data Parsing ∙ 1 day 14 hours back ∙ 44 proposals |
Database parsing
45 USD
Channel requirements: 1. Content language: Russian or Ukrainian (mixed RU/UA content is allowed) 2. Number of subscribers: At least 500 subscribers 3. Activity: The last post published no later than 32 hours ago 4. Comments: Comments must be open under the posts (through a group… Databases & SQL, Data Parsing ∙ 1 day 15 hours back ∙ 32 proposals |
It is necessary to develop a Telegram bot for monitoring cars from auctions in the USA (Copart, IAAI)A Telegram bot is needed for automatic searching and monitoring of "BUY IT NOW" cars at auctions in the USA (Copart, IAAI). The bot should operate automatically and send notifications about new cars that meet the specified filters.Main functionalityFilter settings: 1. Car… Data Parsing, Bot Development ∙ 2 days 16 hours back ∙ 93 proposals |
Los Angeles