Elasticsearch 8.5 implementing Sorting on Nested Fields Returning Inconsistent Results
I'm relatively new to this, so bear with me. I've been struggling with this for a few days now and could really use some help. I'm working with a question when trying to sort documents based on nested fields in my Elasticsearch 8.5 index. My documents have a nested array for 'products', and I want to sort by 'price' within that array. However, when I run a query to fetch these documents, it seems like the sorting isn't consistent, especially when multiple products have the same price. Here’s the structure of my documents: ```json { "title": "Order 123", "products": [ { "name": "Widget A", "price": 25 }, { "name": "Widget B", "price": 30 } ] } ``` My query looks something like this: ```json { "query": { "nested": { "path": "products", "query": { "match_all": {} } } }, "sort": [ { "products.price": { "order": "asc" } } ] } ``` The scenario arises when two documents have the same product price. For instance, if I have two orders with products at the same price, they don't seem to sort consistently. Sometimes, the documents return in a different order upon repeated queries, which is confusing. I've tried adding a secondary sort on a unique field, but it doesn't seem to affect the results. Here’s the modified sort: ```json "sort": [ { "products.price": { "order": "asc" } }, { "_id": { "order": "asc" }} ] ``` However, this also hasn't resolved the scenario. I'm unsure if this is a limitation of sorting on nested fields or if I'm missing some best practices. Any insights on how to achieve stable sorting results when dealing with nested fields would be greatly appreciated! This is part of a larger service I'm building. Am I missing something obvious? This is part of a larger API I'm building. I'm working on a service that needs to handle this. Could someone point me to the right documentation?