Aggregator for the analytics department

Hello!

I work as a Python developer in an international company, where I have been creating intelligent solutions and analysis tools using AI for the past two years. My experience allows me to develop effective solutions that meet modern business and technology requirements. Before this, I worked as a Data Analyst for two years, which gave me a deep understanding of data processing and analysis.

I liked your task; I have long wanted to try implementing multi-threaded data aggregation from various sources, but this is a project with many obstacles. Therefore, I would like to discuss the details, deadlines, and of course, the budget face-to-face)

Thank you for your attention, and I look forward to your order.

Best wishes,
… Andriy

Show original

Translate

Hello, Oleksandr I.

An interesting task, and your concern for analytics and the employees who support it deserves attention.

I have experience with
shukah.info - web aggregator
savdata.ai - modern AI
They are in my portfolio.

… I propose an "Extended option":
If this is to be done properly, then:
Operational response is simply called "real-time analytics"...
Regarding GitHub, of course such projects exist. The question is how fresh they are, and how safe it is to take them as a basis right away. For example: https://github.com/sergienko314/Parser-Twitter_chat-gpt-comments_Telegram-bot
Regarding further requirements - this is AI, a paid OpanAI account, possibly some Google, setting up classification models, normalization, stop-words, etc.
And a very large array of info... we can discuss in PM.

Or an MVP (minimum viable product) option:
We can also discuss in PM.

Respectfully.

Show original

Translate

hello
I have experience in parsing (including Twitter and Telegram, as well as news sites)
I also work on integrating AI

so you want to have a specific list of sources from which news is taken
and also a list of channels where they should be posted
as I understand, each channel will have its own theme

so the first thing to do here is to develop a categorization of news into specific tags, to know where to publish
… it is also possible to develop a combination of several news from different sources into one, to avoid duplicating information in the channel

let's discuss the detailed technical specification

Show original

Translate