NOTE: You are looking at documentation for an older release. For the latest information, see the current release documentation.
Elasticsearch version 6.6.0
edit
IMPORTANT: This documentation is no longer updated. Refer to Elastic's version policy and the latest documentation.
Elasticsearch version 6.6.0
editAlso see Breaking changes in 6.6..
Breaking changes
edit- Cross-cluster replication
- Ranking
- Search
- Watcher
Breaking Java changes
editDeprecations
edit- Aggregations
- Core
- Features
- Mapping
- Scripting
- Search
- Security
- Settings
- Watcher
New features
edit- Aggregations
- Analysis
- Index Lifecycle Management
-
- Adds Index lifecycle feature #35193
- Java High Level REST Client
- Java Low Level REST Client
- Geo
- Machine learning
- Search
- SQL
Enhancements
edit- Aggregations
-
- Enforce max_buckets limit only in the final reduction phase #36152 (issues: #32125, #35921)
- Histogram aggs: add empty buckets only in the final reduce step #35921
- Handles exists query in composite aggs #35758
- Added parent validation for auto date histogram #35670
- Allow unmapped fields in composite aggregations #35331 (issue: #35317)
- Refactor children aggregator into a generic ParentJoinAggregator #34845 (issue: #34210)
- Add parent-aggregation to parent-join module #34210 (issue: #9705)
- Analysis
- Audit
-
- Add "request.id" to file audit logs #35536
- Authentication
-
- Invalidate Token API enhancements - HLRC #36362
- Add DEBUG/TRACE logs for LDAP bind #36028
- Add Tests for findSamlRealm #35905
- Add realm information for Authenticate API #35648
- Formal support for "password_hash" in Put User #35242 (issue: #34729)
- Enhance Invalidate Token API #35388 (issues: #34556, #35115)
- Authorization
- Build
- Core
- Cross-cluster replication
-
- Add time since last auto follow fetch to auto follow stats #36542 (issues: #33007, #35895)
- Clean followed leader index UUIDs in auto follow metadata #36408 (issue: #33007)
- Change AutofollowCoordinator to use wait_for_metadata_version #36264 (issues: #33007, #35895)
- Refactor AutoFollowCoordinator to track leader indices per remote cluster #36031 (issues: #33007, #35895)
- Refactor auto follow coordinator #35895 (issue: #33007)
- CRUD
-
- Document Seq No powered optimistic concurrency control #37284 (issues: #10708, #36148)
- Rename seq# powered optimistic concurrency control parameters to ifSeqNo/ifPrimaryTerm #36757 (issues: #10708, #36148)
- Expose Sequence Number based Optimistic Concurrency Control in the rest layer #36721 (issues: #10708, #36148)
- Add doc’s sequence number + primary term to GetResult and use it for updates #36680 (issues: #10708, #36148)
- Add seq no powered optimistic locking support to the index and delete transport actions #36619 (issues: #10708, #36148)
- Distributed
-
- Allow asynchronous block operations to be delayed in IndexShardOperationPermits #35999 (issues: #35540, #35850)
- TransportResyncReplicationAction should not honour blocks #35795 (issues: #35332, #35597)
- Add global and index level blocks to IndexSettings #35695 (issues: #35332, #35597)
- Expose all permits acquisition in IndexShard and TransportReplicationAction #35540 (issue: #33888)
- Add a java level freeze/unfreeze API #35353 (issues: #34352, #34357)
- Check blocks while having index shard permit in TransportReplicationAction #35332 (issue: #33888)
- Apply masterNodeTimeout to MasterNodeRequest transmission #35235
- Engine
-
- Add sequence numbers based optimistic concurrency control support to Engine #36467 (issues: #10708, #36148)
- Require soft-deletes when access changes snapshot #36446
- Use delCount of SegmentInfos to calculate numDocs #36323
- Always configure soft-deletes field of IndexWriterConfig #36196 (issue: #36141)
-
Always return false from
refreshNeeded
on ReadOnlyEngine #35837 (issue: #35785) -
Add a
_freeze
/_unfreeze
API #35592 (issue: #34352) - Engine.newChangesSnapshot may cause unneeded refreshes if called concurrently #35169
- Do not alloc full buffer for small change requests #35158
- Add IndexShardOperationPermits.asyncBlockOperations(ActionListener<Releasable>) #34902 (issue: #33888)
- Add a frozen engine implementation #34357 (issue: #34352)
- Features
-
- Deprecation check for discovery configuration #36666 (issue: #36024)
- Simplify deprecation issue levels #36326
- Deprecation check for tribe node #36240 (issue: #36024)
-
Deprecation check for
:
in Cluster/Index name #36185 (issue: #36024) - Deprecation check for renamed bulk threadpool settings #36662 (issue: #36024)
- Deprecation check for audit log prefix settings #36661 (issue: #36024)
- Deprecation check for classic similarity #36577 (issue: #36024)
- Deprecation check for HTTP pipelining #36521 (issue: #36024)
- Deprecation check for index threadpool #36520 (issue: #36024)
- Deprecation check for percolator.map_unmapped_fields_as_string #36460 (issue: #36024)
- Deprecation check for http.enabled setting #36394 (issues: #29601, #36024)
- Deprecation check for File Discovery plugin #36190 (issue: #36024)
- Geo
- Ingest
- Java High Level REST Client
-
- Add HLRC support for pause follow API #35216 (issue: #33824)
- Add security Create Token API #34791
- Add start rollup job support to HL REST Client #34623 (issue: #29827)
- Add security authenticate API #33552
- Add get users action #36332 (issue: #29827)
- Add delete template API #36320 (issue: #27205)
- Implement get-user-privileges API #36292
- Get Deprecation Info API #36279 (issue: #29827)
- Added support for Follow Stats API #36253 (issue: #33824)
- Added support for CCR Stats API #36213 (issue: #33824)
- Put Role #36209 (issue: #29827)
- Add index templates exist API #36132 (issue: #27205)
- Add support for CCR Get Auto Follow Pattern apis #36049 (issue: #33824)
- Add support for CCR Delete Auto Follow Pattern API #35981 (issue: #33824)
- Remove fromXContent from IndexUpgradeInfoResponse #35934
- Add delete expired data API #35906 (issue: #29827)
- Execute watch API #35868 (issue: #29827)
- Add ability to put user with a password hash #35844 (issue: #35242)
- Add ML find file structure API #35833 (issue: #29827)
- Add support for get roles API #35787 (issue: #29827)
- Add support for CCR Put Auto Follow Pattern API #35780 (issue: #33824)
- XPack ML info action #35777 (issue: #29827)
- ML Delete event from Calendar #35760 (issue: #29827)
- Add ML revert model snapshot API #35750 (issue: #29827)
- ML Get Calendar Events #35747 (issue: #29827)
-
Add high-level REST client API for
_freeze
and_unfreeze
#35723 (issue: #34352) - Fix issue in equals impl for GlobalOperationPrivileges #35721
- ML Delete job from calendar #35713 (issue: #29827)
- ML Add Event To Calendar API #35704 (issue: #29827)
- Add ML update model snapshot API (#35537) #35694 (issue: #29827)
- Add support for CCR Unfollow API #35693 (issue: #33824)
- Clean up PutLicenseResponse #35689 (issue: #35547)
- Clean up StartBasicResponse #35688 (issue: #35547)
- Add support for put privileges API #35679
- Add Job to Calendar API #35666 (issue: #29827)
- Add support for CCR Resume Follow API #35638 (issue: #33824)
- Add support for get application privileges API #35556 (issue: #29827)
- Clean up XPackInfoResponse class and related tests #35547
- Add parameters to stopRollupJob API #35545 (issue: #34811)
- Add ML delete model snapshot API #35537 (issue: #29827)
- Add get watch API #35531 (issue: #29827)
- Add ML Update Filter API #35522 (issue: #29827)
- Add ML get filters api #35502 (issue: #29827)
- Add ML get model snapshots API #35487 (issue: #29827)
- Add "_has_privileges" API to Security Client #35479 (issue: #29827)
- Add Delete Privileges API to HLRC #35454 (issue: #29827)
- Add support for CCR Put Follow API #35409
- Add ML delete filter action #35382 (issue: #29827)
- Add delete user action #35294 (issue: #29827)
- HLRC for _mtermvectors #35266 (issues: #27205, #33447)
- Reindex API with wait_for_completion false #35202 (issue: #27205)
- Add watcher stats API #35185 (issue: #29827)
- Add ML API PUT filter #35175 (issue: #29827)
- HLRC support for getTask #35166 (issue: #27205)
- Add support for the clear realm cache API #35163 (issue: #29827)
- Add InvalidateToken security API #35114 (issue: #29827)
- Add GetRollupIndexCaps API #35102 (issue: #29827)
- Migration api - upgrade #34898 (issue: #29827)
- Add Update datafeed API #34882 (issue: #29827)
- Add stop rollup job support to HL REST Client #34702 (issue: #29827)
- Bulk Api support for global parameters #34528 (issue: #26026)
- Add support for source exists API #34519 (issue: #27205)
- Add document _count API support to Rest High Level Client. #34267 (issue: #27205)
- Add delete rollup job support to HL REST Client #34066 (issue: #29827)
- HLRC API for _termvectors #33447 (issue: #27205)
- Add support for get license basic/trial status API #33176 (issue: #29827)
- Small corrections to HLRC doc for _termvectors #35221 (issue: #33447)
- Java Low Level REST Client
-
- On retry timeout add root exception #25576
- Machine Learning
-
- Create the machine learning annotations index #36731 (issue: #33376)
- Add cluster setting to enable/disable config migration #36700 (issue: #32905)
-
Enable the use of endpoints starting with
_ml
instead of_xpack/ml
#36373 (issue: #36315) - Add audits when deprecation warnings occur while datafeeds start #36233
- Add lazy parsing for DatafeedConfig:Aggs,Query #36117
- Add support for rollup indexes in datafeeds #34654
- Monitoring
- Network
- Packaging
- Plugins
-
- Plugin install: don’t print download progress in batch mode #36361
- Recovery
- Rollup
- Scripting
- Search
-
- Use SearchRequest copy constructor in ExpandSearchPhase #36772 (issue: #36641)
- Add copy constructor to SearchRequest #36641 (issue: #32125)
- Add raw sort values to SearchSortValues transport serialization #36617 (issue: #32125)
-
Warn when using
use_dis_max
inmulti_match
#36614 (issue: #36488) - Add sort and collapse info to SearchHits transport serialization #36555 (issue: #32125)
- Add default methods to DocValueFormat #36480
- Extend field caps API to mark meta fields #36309
- Respect indices options on _msearch #35887
- Allow efficient can_match phases on frozen indices #35431 (issues: #34352, #34357)
-
Apply
ignore_throttled
also to concrete indices #35335 (issue: #34354) - Adapt field limit deprecation warning #35302 (issue: #35284)
- Upgrade 6.x to lucene-7.6.0-snapshot-f9598f335b #35225
- Prevent throttled indices to be searched through wildcards by default #34354 (issues: #33732, #34352)
- check for null argument is already done in splitStringByCommaToArray #34268
- has_parent builder: exception message/param fix #31182
- Security
- Snapshot/Restore
- SQL
-
-
Make
FULL
non-reserved keyword in the grammar #37377 (issue: #37376) - Extend the ODBC metric by differentiating between 32 and 64bit platforms #36753 (issue: #36740)
- Fix wrong appliance of StackOverflow limit for IN #36724 (issue: #36592)
- Introduce NOW/CURRENT_TIMESTAMP function #36562 (issue: #36534)
- Move requests' parameters to requests JSON body #36149 (issue: #35992)
- Make INTERVAL millis optional #36043 (issue: #36032)
- Implement data type verification for conditionals #35916 (issue: #35907)
- Implement GREATEST and LEAST functions #35879 (issue: #35878)
-
Implement null safe equality operator
<=>
#35873 (issue: #35871) - SYS COLUMNS returns ODBC specific schema #35870 (issue: #35376)
- Polish grammar for intervals #35853
- Add filtering to SYS TYPES #35852 (issue: #35342)
- Implement NULLIF(expr1, expr2) function #35826 (issue: #35818)
- Lock down JDBC driver #35798 (issue: #35437)
- Implement NVL(expr1, expr2) #35794 (issue: #35782)
- Implement ISNULL(expr1, expr2) #35793 (issue: #35781)
- Implement IFNULL variant of COALESCE #35762 (issue: #35749)
- XPack FeatureSet functionality #35725 (issue: #34821)
- Perform lazy evaluation of mismatched mappings #35676 (issues: #35659, #35675)
- Improve validation of unsupported fields #35675 (issue: #35673)
- Move internals from Joda to java.time #35649 (issue: #35633)
- Improve CircuitBreaker logic for SqlParser #35300 (issue: #35299)
- Upgrade jline to version 3.8.2 #35288
- New SQL CLI logo #35261
- Introduce Coalesce function #35253 (issue: #35060)
- Optimizer rule for folding nullable expressions #35080 (issue: #34826)
-
Improve painless script generated from
IN
#35055 (issue: #34750) - Implement CAST between STRING and IP #34949 (issue: #34799)
- Fix function args verification and error msgs #34926 (issues: #33469, #34752)
- Handle X-Pack or X-Pack SQL not being available in a more graceful way #34736 (issue: #30009)
-
Make
- Stats
- Task Management
Bug fixes
edit- Aggregations
-
- Fix MultiValuesSourceFieldConfig toXContent #36525 (issue: #36474)
- Cache the score of the parent document in the nested agg #36019 (issues: #34555, #35985)
- Correct implemented interface of ParsedReverseNested #35455 (issue: #35449)
- Handle IndexOrDocValuesQuery in composite aggregation #35392
-
Preserve
format
when aggregation contains unmapped date fields #35254 (issue: #31760) - Check self references in metric agg after last doc collection (#33593) #34001
- Audit
- Authentication
- Build
- Circuit Breakers
- Core
-
- Revert back to joda’s multi date formatters #36814 (issues: #36447, #36602)
- Fix CompositeBytesReference#slice to not throw AIOOBE with legal offsets. #35955 (issue: #35950)
- Suppress CachedTimeThread in hot threads output #35558 (issue: #23175)
- Upgrade to Joda 2.10.1 #35410 (issue: #33749)
- XContent: Check for bad parsers #34561 (issue: #34351)
- Cross-cluster replication
-
- Add fatal_exception field for ccr stats in monitoring mapping #37563
- When removing an AutoFollower also mark it as removed. #37402 (issue: #36761)
- Make shard follow tasks more resilient for restarts #37239 (issue: #37231)
- Resume follow Api should not require a request body #37217 (issue: #37022)
- Report error if auto follower tries auto follow a leader index with soft deletes disabled #36886 (issue: #33007)
- Remote cluster license checker and no license info. #36837 (issue: #36815)
- Make CCR resilient against missing remote cluster connections #36682 (issues: #36255, #36667)
- Fix follow stats API’s follower index filtering feature #36647
- AutoFollowCoordinator and follower index already created #36540 (issue: #33007)
- AutoFollowCoordinator should tolerate that auto follow patterns may be removed #35945 (issue: #35937)
- Only auto follow indices when all primary shards have started #35814 (issue: #35480)
- Avoid NPE in follower stats when no tasks metadata #35802
- Fix the names of CCR stats endpoints in usage API #35438
- CRUD
- Distributed
- Engine
- Features
- Geo
-
- More robust handling of ignore_malformed in geoshape parsing #35603 (issues: #34047, #34498)
- Better handling of malformed geo_points #35554 (issue: #35419)
- Enables coerce support in WKT polygon parser #35414 (issue: #35059)
- Further improve robustness of geo shape parser for malformed shapes #34498 (issues: #31449, #34047)
- Index lifecycle management
-
-
Remove
indexing_complete
when removing policy #36620
-
Remove
- Index APIs
- Ingest
- Machine Learning
-
- Fix cause of "Sample out of bounds" error message. #335
- Fix hang when closing a job or creating a forecast. This problem occurs if you created a forecast for a large job and temporary storage was not cleaned up. #352 (issue: #350)
- Wait for autodetect to be ready in the datafeed #37349 (issues: #36810, #37227)
- Stop datafeeds when their jobs are stale #37227 (issue: #36810)
- Order get job stats API response by job id #36841 (issue: #36683)
- Mapping
-
- Make sure to accept empty unnested mappings in create index requests. #37089
- Monitoring
- Network
- Packaging
- Ranking
- Recovery
-
- Register ResyncTask.Status as a NamedWriteable #36610
- Rollup
- Scripting
-
- Properly support no-offset date formatting #36316 (issue: #36306)
- [Painless] Generate Bridge Methods #36097
- Fix serialization bug in painless execute api request #36075 (issue: #36050)
- Actually add joda time back to whitelist #35965 (issue: #35915)
- Add back joda to whitelist #35915 (issue: #35913)
- [Painless] Partially fixes def boxed types casting #35563 (issue: #35351)
- Add back lookup vars in score script #34833
- Search
-
- Inner hits fail to propagate doc-value format. (#36310) #36355 (issue: #36310)
- Fix custom AUTO issue with Fuzziness#toXContent #35807 (issue: #33462)
- Fix analyzed prefix query in query_string #35756 (issue: #31702)
- Fix problem with MatchNoDocsQuery in disjunction queries #35726 (issue: #34708)
- Fix phrase_slop in query_string query #35533 (issue: #35125)
- Add a More Like This query routing requirement check (#29678) #33974
- Security
- Settings
- Snapshot/Restore
- SQL
-
- Fix issue with field names containing "." #37364 (issue: #37128)
- Proper handling of COUNT(field_name) and COUNT(DISTINCT field_name) #37254 (issue: #30285)
- Fix COUNT DISTINCT filtering #37176 (issue: #37086)
- Fix issue with wrong NULL optimization #37124 (issue: #35872)
- Count distinct doesn’t recognize that a string field has a keyword version #37176 (issue: #37087)
- Handle the bwc Joda ZonedDateTime scripting class in Painless #37024 (issue: #37023)
- Fix bug regarding histograms usage in scripting #36866
- Fix issue with always false filter involving functions #36830 (issue: #35980)
- Protocol returns ISO 8601 String formatted dates instead of Long for JDBC/ODBC requests #36800 (issue: #36756)
- Fix translation of LIKE/RLIKE keywords #36672 (issues: #36039, #36584)
- Scripting support for casting functions CAST and CONVERT #36640 (issue: #36061)
- Fix translation to painless for conditionals #36636 (issue: #36631)
- Concat should be always not nullable #36601 (issue: #36169)
- Fix MOD() for long and integer arguments #36599 (issue: #36364)
- Fix issue with complex HAVING and GROUP BY ordinal #36594 (issue: #36059)
- Be lenient for tests involving comparison to H2 but strict for csv spec tests #36498 (issue: #36483)
- Non ISO 8601 versions of DAY_OF_WEEK and WEEK_OF_YEAR functions #36358 (issue: #36263)
- Do not ignore all fields whose names start with underscore #36214 (issue: #36206)
- SUM() and LIKE condition doesn’t work anymore #36672 (issue: #36161)
- Fix issue with wrong data type for scripted Grouping keys #35969 (issue: #35662)
- Fix translation of math functions to painless #35910 (issue: #35654)
- Build: Fix jdbc jar to include deps #35602
- Fix query translation for scripted queries #35408 (issue: #35232)
- Clear the cursor if nested inner hits are enough to fulfill the query required limits #35398 (issue: #35176)
- Fix null handling for AND and OR in SELECT #35277 (issue: #35240)
-
Handle null literal for AND and OR in
WHERE
#35236 (issue: #35088) - Introduce NotEquals node to simplify expressions #35234 (issues: #35210, #35233)
- Introduce IsNull node to simplify expressions #35206 (issues: #34876, #35171)
- Handle wildcard expansion on incorrect fields #35134 (issue: #35092)
- Fix null handling for IN ⇒ painless script #35124 (issues: #35108, #35122)
- Register missing processors #35121 (issue: #35119)
- Fix NPE thrown if HAVING filter evals to null #35108 (issue: #35107)
- Proper handling of nested fields at the beginning of the columns list #35068 (issue: #32951)
- Fix incorrect AVG data type #34948 (issue: #33773)
-
Add
CAST
andCONVERT
toSHOW FUNCTIONS
#34940 (issue: #34939) - Handle aggregation for null group #34916 (issue: #34896)
- Provide null-safe scripts for Not and Neg #34877 (issue: #34848)
- Return error with ORDER BY on non-grouped. #34855 (issue: #34590)
- Fix negation of equals comparison. #34680 (issue: #34558)
- CAST doesn’t work in ORDER BY. #36640 (issue: #34557)
- COUNT(column) takes into account NULLs #37254 (issue: #34549)
- Watcher