ETL data processing with Python
We are looking for a talented Python developer to work with our analytics and data science back-end. This role will include productizing algorithm and machine learning scripts to improve performance. Building deployment and validation processes. The ideal candidate will have the ability to break up complex problems into manageable parts. Delegate and prioritize tasks to internal and external resources. Collaborate with the data science and ops teams. Report progress to management and users.
Requirements
2 to 5 years of Python experience, functional and OOP style
Should be comfortable with: SQLAlchemy, NumPy, Pandas, SciPy, Boto3
Strong SQL, MySQL or PostgreSQL
Experience optimizing and parallelizing code
Experience with asynchronous patterns in Python, Celery or Asyncio
Nice to have
Experience writing scientific software in Python
Background in science or engineering
Experience with a scheduler such as AirFlow or Jenkins
Other technologies: Redshift Spectrum, Spark, Hadoop
Workload: Half-time or Full-time
-
123 days13 USD
169 123 days13 USD
I've worked with almost all of those, except Boto3 and "optimizing and parallelizing code". Nonetheless, I've done parallel programming in other languages.
My CV - gildedhonour.me
I'm in the Mexican time-zone. Let's discuss.
-
Remote job ? Full time ?
-
Workload: Half-time or Full-time
-
Give me a task
-
Current freelance projects in the category Data Parsing
Need a parser for the online store https://www.lcsc.com/It is necessary to regularly (once a month, or upon script launch) obtain up-to-date information about the products available in the store. https://www.lcsc.com/ from the catalog of all sections.… Data Parsing ∙ 6 hours 25 minutes back ∙ 28 proposals |
OpenCart — rental catalog of special equipment
135 USD
OpenCart — Equipment Rental Catalog Need to launch an equipment rental catalog on OpenCart. Theme: excavators cherry pickers forklifts generators cranes scaffolding other construction equipment. It is preferable that you already have a ready-made template or developments… Web Programming, Data Parsing ∙ 22 hours 51 minutes back ∙ 46 proposals |
Transfer the program - the server where the program was located has crashed (officially permitted parsing of government data)
47 USD
Hello! My client has encountered the case described below. We need help transferring to a new server and testing the program. It would be better to have a programmer who understands parsing. Software & Server Configuration, Data Parsing ∙ 1 day 2 hours back ∙ 27 proposals |
Website parsingImplementation of 4 parsers (directory websites) is required. There is a technical specification, and there is a code example as a reference. The tasks include: Writing a parser Integrating a proxy Deduplication logic (transfer the logic from the example) Hashing logic based… Data Parsing ∙ 2 days 19 hours back ∙ 42 proposals |
Collection (parsing) of product database from supplier websites (Excel / CSV)
226 USD
Collection of product database from supplier websites (Excel / CSV) Good day. A specialist is required to collect and structure data from several supplier websites, access to which will be provided.Task: A unified product database needs to be created in Excel (XLSX) or CSV… Web Programming, Data Parsing ∙ 4 days 2 hours back ∙ 103 proposals |
Los Angeles