- Projects 7
- Rating -
- Rating 204
Budget: 2500 RUB Deadline: 3 days
Hi, I have experience in optimizing BD and requests, with pleasure to help. In my practice, there was a case when the tables contained at least 300k records and created so much burden that the provider threatened with a refusal to cooperate. As a result, it works now without any problems. Your case reminds me of that. First, I need more information on the structure of the BD and on request. I look forward to your messages.
Proposals concealed
Proposals are currently absent
-
Andrey Mestny 13 September 2019Вы используете LIKE '%".$teg."%' то есть ищите подстроку в значении поля, соответственно перебираете каждый раз все 100.000 записей, вам нужно отказаться от этой практики. SQL запрос правильный, но вы неправильно ставите задачу своему SQL серверу, подумайте как не ставить знак процента впереди искомой подстроки.
-
Andrey Mestny 13 September 2019Нет, вам нужно отказаться от поиска подстроки в поле, можно искать слово, если использовать полнотекстовый поиск, а поиск подстроки всегда будет очень медленным на больших базах.
-
Andrey Mestny 13 September 2019Даже если уберете процент вначале запроса Like оставив его только в конце то уже поиск будет идти по индексу и будет быстрым.
-
Ivan Kolenov
13 September 2019
в поле есть текст "Мото Ауто Форум Деньги Золото"
Как найти по другому все записи где есть слово Форум между 100 000 записей не используя %Форум%?
-
Andrey Mestny 13 September 2019Если вам нужно полное слово форум, то через полнотекстовый поиск, а если вы хотите искать подстроку например фор** или **орум то ничего вам не поможет, кроме медленного выполнения запроса.
-
Andrey Mestny 13 September 2019Вернее если вы издадите запрос like '%фор% то запрос будет выполняться медленно, а если like 'фор% то результат будет мгновенным.
-
Ivan Kolenov
13 September 2019
"Мото Ауто Форум Деньги Золото"
не сможет найти поля со словом Форум% так как слово между другими словами
-
Andrey Mestny 13 September 2019Тогда вам нужно подумать как построить программу так, чтобы этого не было, полное слово ФОРУМ вы можете искать через полнотекстовый поиск, а подстроку *ОРУМ никак только загружая на 100 % процессор и память.
-
Andrey Mestny 13 September 2019Если вы хотите в перечне осмысленных слов "Мото Ауто Форум Деньги Золото" найти слово Форум и создадите полнотекстовый индекс по этому полю, то тогда MySQL найдет слово Форум мгновенно. Но слово должно быть осмысленным, чтобы MySQL понял что вы ищите именно Форум. Он так же найдет и слово Форумы, Форума, Форумов, Форума и т.д. Но слово ОРУМ полнотекстовый поиск не найдет, а like '%ОРУМ%' найдет.
-
Oleksii K. 13 September 2019Если Вы хотите использовать полнотекстовый поиск, Вам стоит отказаться от поиска по MySQL) такими запросами и по такой базе))).
решение(если VPS): делать связку ЦМС - ...
-
Andrey Mestny 13 September 2019Вам нужно использовать WHERE MATCH(`cosmos`) AGAINST('форум'), а не Like
-
Free Web 13 September 2019Попробуйте еще регулярными выражениями - может будет быстрее
Пример: SELECT name FROM metal WHERE name REGEXP 'Форум';
-
Andrey Mestny 13 September 2019Вам в каком виде вообще помощь нужна ? В виде совета, просмотра ваших SQL запросов или реальной перетряски всего вашего проекта, через SSH доступ к вашему серверу и пересмотр всей концепции поиска.
-
Ivan Kolenov
13 September 2019
на стороне сервера я смогу все сам настроить, мне нужно оптимизировать запрос LIKE или заменить его...
-
Andrey Mestny 13 September 2019Найдите доку как использовать полнотекстовый поиск в MySQL если MySQL слишком древний, то вам придется его обновить до версии поддерживающей полнотекстовый поиск. Если уж ничего не поможет, то пишите в личку договоримся.
-
Roman Bezfamilny 14 September 2019Напишите в личку, скину вам сайт, где я в почти 2-х млн. сделал быстрый поиск внутри текста.
Current freelance projects in the category Databases & SQL
About the project and tasks We have a small sales department (sales department head + 2 managers) and a database of about 220 active clients. There is an urgent need to implement a simple CRM as an operational level so that managers can record calls, agreements, and statuses in the sales funnel in real-time, while management can see which clients are "stuck" at a certain stage. At the same time, we actively use AI analytics (Claude) for working with exports, reports, anomaly detection, and P&L analysis. Therefore, the CRM is needed as a clean data source from which quality exports can be generated. What needs to be done (Stage 1 — Implementation) Audit and solution selection. Finally determine the platform together with us. We are considering Ukrainian solutions (KeyCRM or SalesDrive) as integration with Ukrainian telephony and Nova Poshta is important. We are also open to considering Pipedrive. System setup. Creating a sales funnel, client cards, and configuring fields according to our specifics. Integrations. Connecting telephony, messengers, and Nova Poshta. Data import. Correct transfer of the existing client base (about 220 contacts) from current files. Training. A brief briefing for the sales department head and two managers on the rules for managing deals to ensure data cleanliness and quality in the CRM. Further tasks (Stage 2 — Support) Technical support and refinement of automations during the work process. Monitoring the correctness of data exports for further AI analytics. Who we are looking for A specialist with experience in implementing KeyCRM, SalesDrive, or Pipedrive (please include examples or cases in your response). A person who understands the principles of building sales analytics and can configure data exports without "garbage". A responsible specialist ready for long-term cooperation and project support. In your response, please indicate Your experience with KeyCRM, SalesDrive, or Pipedrive. Estimated cost and time for basic setup for our team (3 users). Whether you are ready to further administer the system and under what conditions.
About the Company Trading company. We work with a product group of more than 2000 items across different categories.Current Situation Currently, the nomenclature is maintained in Google Sheets — data is consolidated by tabs (categories). Tab Structure: Product name Price groups: cost price, wholesale, retail Characteristics: weight, quantity per package, etc. Important: the number of columns varies for different product categories, as they have different characteristics.Why the Current Solution is Inadequate Google Sheets does not allow setting access rights at the level of individual columns. We need to: Grant users rights to view certain columns (for example, only cost prices) Grant rights to edit certain columns (for example, retail prices) While restricting access to other columns in the same tabWhat Needs to Be DoneMain Requirements Flexible Rights Management System Access at the level of individual columns (read/write) Assignment of rights by roles or users Management of rights without the involvement of programmers Support for Different Data Structures Different product categories have different sets of characteristics Adding new columns/characteristics without programming Independence from Developers Administration by internal staff Adding categories, columns, users — through the interface Integration with ERP Exporting current prices to our ERP system Export or automatic integration via API Data Analysis Using AI (preferably) Ability to analyze the entire nomenclature list Enrichment, verification, recommendations — if you have ideas, please describeExpected Result A working solution in which: The nomenclature is structured by categories with different sets of characteristics Column rights are flexibly configured (view/edit) Data is exported to ERP The team can manage the system independentlyWhat We Need from You When Responding Describe in general terms how you envision the solution: What tool/platform do you propose
A deep technical verification of three PDF files for authenticity and possible signs of editing or forgery is required. Not only a visual assessment of the documents is needed. The performer must have a good understanding of the internal structure of PDF files and be able to analyze: file metadata; PDF structure and individual objects; creation history and possible editing; software used; embedded fonts, images, layers, and other elements; possible signs of re-saving, conversion, modifications, or backdating of the document; any technical discrepancies that may indicate manipulation of the files. Based on the verification results, a clear written conclusion regarding each file must be provided, indicating the identified signs, risks, and limitations of the verification. We are considering specialists who have practical experience in digital forensics, PDF document analysis, metadata, or verifying electronic files for authenticity. In your response, please briefly describe your experience, methods, and tools that you use for such verification.
General information It is necessary to develop a simple minimalist web system, the main purpose of which is to maintain a client database, create appointments for visits, and automate the process of confirming visits via SMS, sending one-time links through the API from the service itself. The project is being developed in stages. In the first stage, it is necessary to implement only the basic functionality (MVP) so that the system can be used in real work. After launch and testing, it will gradually be expanded with new modules.Main functionality of the first stage User authorization; Client database; Creating and editing appointments; List of appointments (or a simple calendar); Switching between points of sale; Integration with the SMS operator via API; Sending SMS with any text or link for visit confirmation; Confirmation or cancellation of the visit by the client via a one-time link; Displaying the confirmation status directly next to the client's appointment. At the initial stage, instead of a full calendar, the use of a simple list of appointments by days is allowed. Each day should contain a chronological list of bookings indicating the time, client's name, service, employee, and confirmation status. Later, this list can be replaced with a full calendar without changing the system structure. The system must have the ability to switch between points of sale. Each point of sale has its own list of appointments (or calendar), but they all use a common client database.
Copying the database and front for the database (Currently, the front is partially copied and some characteristics are incorrect. The parser filled the database with its own characteristics) Synchronizing the parser with the database and the characteristics of the database Fixing the bug in the parser agent Cropping photos proportionally to the watermark that comes from the parser Working with the buffer with the new database and tools with the objects of this database Fixing minor bugs: for example, text in pop-ups, or small issues on the front, bugs that appear during task execution Connecting a new storage for media storage Logs have stopped writing to the financial operations table, which affects the balance and tariff plan pages (payment of the tariff, account replenishment (successful/not)) Check the payment functionality again and then replace the test billing API from Monobank with the real one Refine access rights for the database administrator user There are currently hanging processes that load the server; this needs to be checked The logic of comments and notes is currently working incorrectly; it needs to be such that for the same object in 2 databases - comments are tied to each database, not to the object, the source of which is the object of this database (I can explain in more detail in private) Fix the sorting in the databases correctly (Currently from the first added to the last. It needs to be the opposite; the sorting functionality is created) Check and correct the accuracy of filters in the databases, possibly add restrictions on filtering with large data volumes