Python | Automation of Data Collection and Analysis

Hello, I am eager. I can make a currency calculator with API in a console version because I don't do anything graphically, I do the backend in Python. I can do for free because I am a young programmer (alternatively, if the currency calculator will meet all the conditions to can be even a symbolic fee of 50-60USD) and I am still learning:) I have a very good grasp of Python basics and this is a learning opportunity for me. My portfolio and profile on GitHub: https://github.com/Ola-Kaznowska

Good day, our team is happy to assist you in developing such a service. Please write to us privately, we will discuss the details.

Show original

Translate

Hello, I am ready to do it, feel free to reach out!
The work will be done with high quality!
I will be happy to collaborate!

Show original

Translate

Good day, we are the company Easy Dev, we saw your order and are ready to implement it quickly and efficiently!

My name is David, I am one of the Senior developers at EasyDev. I currently have a free team. I suggest having a call with me, usually we take projects on outsource, but at the same time we have close contact with the client (you will see progress in text form 2 or more times a week or we will have Daily Meetings for 15 minutes).

If you are interested in this option, let's discuss the project today or tomorrow at any convenient time for you. Thank you very much for your attention!

Show original

Translate

Ready to complete the task at a price of $200 for each stage. We can make adjustments and renegotiate certain points during the work process to achieve better results. The cost includes revisions of the program if necessary.

Show original

Translate

Hello. We are the web studio SYP. We have thoroughly reviewed your task. We are ready to complete your project "turnkey". Write to us, and we will discuss all the details.

Show original

Translate

We can create a Python program for automatic extraction, processing, and uploading of data from Excel spreadsheets received via email to BigQuery.

Implementation stages:
Data extraction from email:

Connecting via IMAP or Gmail API to check for new emails every day.
Downloading attachments in Excel format and saving them on the server.
Data processing:

… Merging Excel files into one table.
Standardization: aligning company formats, currency conversion (via API), unifying date and number formats.
Using VLOOKUP for searching and merging data.
Geocoding addresses to add coordinates.
Uploading to BigQuery:

Setting up the connection and automatically uploading the summary table to BigQuery (overwrite or append data).
Reporting and notifications:

Logging all actions and sending an email notification upon task completion.
Recommended deployment: Deploy on a cloud server for stable operation.

Timeline and budget:
Timeline: 3-4 weeks
Budget: negotiable
Ready to discuss details and start the project.

Show original

Translate

Hello!

My name is Eric, and I would be happy to participate in your project. I have over 5 years of experience in Python development, particularly in creating automated solutions for data processing, API integrations, as well as setting up server environments. Your project is very interesting to me as it combines several aspects I have already dealt with.

Proposed solution architecture:

Data loading from email:
I will set up integration with your email account via IMAP or Gmail API to automatically find new emails with attached Excel files. Attachments can be downloaded to your local computer or to cloud storage, or both options simultaneously, depending on your needs and preferences.

… Data processing:
To merge tables and standardize data (for example, date formats, numbers, company names), we will use the Pandas library. I will integrate an API for automatic currency conversion at the current rate, as well as geocoding addresses via Google Maps API. I will implement a VLOOKUP mechanism directly in the Python script to combine data from different tables.

Loading into BigQuery:
I will set up integration with BigQuery via Google Cloud SDK for automatic creation or updating of tables. The choice between overwriting or adding new rows will also be possible.

Flexibility in deployment:
I propose to create a Docker container for this solution, which will allow it to be deployed on your computer, server, or in the cloud. This will ensure ease and speed of deployment and scaling. I will provide detailed instructions for setup and usage.

Logging and notifications:
I will implement logging of all processes so you can see the status of task execution. After each processing is completed, you will receive an automatic notification via email with a brief report.

Why choose me:
I have extensive experience in automating data processing and integrating with various services. Additionally, I know how to set up infrastructure to be flexible and easily scalable. Your task is interesting, and I am ready to offer a simple and convenient solution that can be easily adapted to any future needs. My goal is not just to complete the project but to make it convenient and effective for you in the long term.

I would be happy to discuss the details and propose the best option for your case. I look forward to collaborating!

Best regards,
Eric

Show original

Translate

Good day👋 I am engaged in developing scripts for automating processes and solving tasks of any complexity. I guarantee quality execution and reliable results. I will be happy to help you with the implementation of your project!

Show original

Translate

Hello! My name is Bogdan. I would like to work on your project. I have already worked with almost all the scope of technologies listed by you above.

The overall architecture of the solution that I see:

Google Cloud Function — I recommend using it for small scripts.

Data processing:

IMAP protocol — will parse your Gmail, find messages with Excel attachments, and upload them to the cloud environment.
…
Pandas — for merging all data and all tasks related to data transformation (currency conversion, working with dates).

For currency conversion, a free API can also be used.

For geocoding, you can connect the Google Maps API.

Data storage and processing:

BigQuery — for uploading and processing data.

Logging and notifications:
Cloud Logging — for recording logs.

Email notifications can be set up via SMTP. If you want to receive notifications in Telegram, a Telegram bot can be used.

All this work cannot possibly cost 200; if you are willing to reconsider the budget and set up Milestones for the second phase, I would be happy to discuss the details.

Show original

Translate

Good afternoon. I am ready to complete the task.
I have experience in creating similar projects for process automation.
I write in Python and hold 3rd place on the platform.

I will create a program that will check the email, analyze the received messages, save the necessary Excel files, the received files will be merged and standardized, and then uploaded to the database. I will connect an API for converting values into a single currency. I will create a user-friendly interface and optimize it. You will be able to view the log of all ongoing tasks. I will deploy it on the server.

My portfolio: Freelancehunt
Write to me, we will discuss the details and I will start working.

Show original

Translate