File: //usr/local/lib/python3.6/site-packages/uhashring/__pycache__/ring.cpython-36.pyc
3
��x`�+ � @ s6 d dl m Z d dlmZ d dlmZ G dd� d�ZdS )� )�bisect)�
KetamaRing)�MetaRingc @ s8 e Zd ZdZg fdd�Zdd� Zdd� ZeZdd � ZeZ d
d ifd d
�Z
e
Z dd� Z dd� Z
dd� Zdd� Zdd� Zdd� Zdd� Zd d � Zd d � Zd d!� Zd"d#� Zd$d%� Zd&d'� Zd@d)d*�Zd+d,� ZdAd.d/�Zd0d1� Z e d2d3� �Z e Z e d4d5� �Z e d6d7� �Z!e!Z"e d8d9� �Z#e d:d;� �Z$e d<d=� �Z%e d>d?� �Z&d-S )B�HashRingz$Implement a consistent hashing ring.c K s� |j dd�}|j dd�}|j dd�}|dkrXdd� |j� D �}|dkrJd}tf |�| _n|dkrdd }t|�| _|| _| jj| _|r�t|d
� r�td ��|| _ | j
|�r�| jj | jj j� � dS ) a� Create a new HashRing given the implementation.
:param nodes: nodes used to create the continuum (see doc for format).
:param hash_fn: use this callable function to hash keys, can be set to
'ketama' to use the ketama compatible implementation.
:param vnodes: default number of vnodes per node.
:param weight_fn: use this function to calculate the node's weight.
�hash_fnN�vnodes� weight_fnZketamac S s i | ]\}}|dkr||�qS )�replicas)r � )�.0�k�vr
r
�8/usr/local/lib/python3.6/site-packages/uhashring/ring.py�
<dictcomp> s z%HashRing.__init__.<locals>.<dictcomp>�( � �__call__z'weight_fn should be a callable function)
�get�itemsr �runtimer �_default_vnodes�hashi�hasattr� TypeError�
_weight_fn�_configure_nodes� _create_ring�_nodes)�self�nodes�kwargsr r r Z ketama_argsr
r
r �__init__
s$
zHashRing.__init__c
C s< t |t�r|g}n t |ttf�s2tdjt|����d}� x�|D ]�}|d|d| jdd�}| jj j
|i �}|}|srd}t |t�� r�|| }t |t �r�||d< n^t |t�r�xR|j � D ]2\}} ||kr�| ||< |d kr�|j
|�| kr�d}q�W ntd
jt|����| j
�r| j
f |�|d< |j
d�|d k�r(d}|| jj |< q>W |S ) zzParse and set up the given nodes.
:param nodes: nodes used to create the continuum (see doc for format).
z6nodes configuration should be a list or a dict, got {}FN� )�hostname�instance�nodename�portr �weightTr' r% r z5node configuration should be a dict or an int, got {})r% r r' )�
isinstance�str�dict�list�
ValueError�format�typer r r r �intr r )
r r Z conf_changed�node�confZ current_confr% Z node_confr r
r
r
r r + sL
zHashRing._configure_nodesc C s | j j|� dS )zHRemove the given node.
:param nodename: the node name.
N)r Z _remove_node)r r% r
r
r � __delitem__a s zHashRing.__delitem__c C s | j |d�S )zlReturns the instance of the node matching the hashed key.
:param key: the key to look for.
r$ )�_get)r �keyr
r
r � __getitem__j s zHashRing.__getitem__r' r" c C s* | j ||i�r&| jj|| j| fg� dS )z�Add the given node with its associated configuration.
:param nodename: the node name.
:param conf: the node configuration.
N)r r r r )r r% r1 r
r
r � __setitem__s s zHashRing.__setitem__c C s0 t | jj| j|��}|t| jj�kr(dS |S dS )a: Get the index of the given key in the sorted key list.
We return the position with the nearest hash based on
the provided key unless we reach the end of the continuum/ring
in which case we return the 0 (beginning) index position.
:param key: the key to hash and look for.
r N)r r �_keysr �len)r r4 �pr
r
r �_get_pos~ s zHashRing._get_posc C s� | j js dS | j|�}|dkr"|S | j j| j j| }|d
krN| j j| | S |dkrb| j j| S |dkrn|S |d kr�| j j| |fS dS ) a� Generic getter magic method.
The node with the nearest but not less hash value is returned.
:param key: the key to look for.
:param what: the information to look for in, allowed values:
- instance (default): associated node instance
- nodename: node name
- pos: index of the given key in the ring
- tuple: ketama compatible (pos, name) tuple
- weight: node weight
N�posr# r$ r& r' r* r% �tuple)r# r$ r& r' )r �_ringr: r7 r )r r4 �whatr; r% r
r
r r3 � s
z
HashRing._getc C s | j |d�S )zhReturns the node object dict matching the hashed key.
:param key: the key to look for.
r* )r3 )r r4 r
r
r r � s z HashRing.getc C s dd� | j jj� D �S )z<Returns a list of the instances of all the configured nodes.c S s g | ]}|j d �r|j d ��qS )r$ )r )r �cr
r
r �
<listcomp>� s z*HashRing.get_instances.<locals>.<listcomp>)r r �values)r r
r
r �
get_instances� s zHashRing.get_instancesc C s
| j |�S )z�Alias of ketama hashi method, returns the hash of the given key.
This method is present for hash_ring compatibility.
:param key: the key to look for.
)r )r r4 r
r
r �get_key� s zHashRing.get_keyc C s | j |d�S )zmReturns the node name of the node matching the hashed key.
:param key: the key to look for.
r% )r3 )r r4 r
r
r �get_node� s zHashRing.get_nodec C s | j |d�S )zlReturns the hostname of the node matching the hashed key.
:param key: the key to look for.
r# )r3 )r r4 r
r
r �get_node_hostname� s zHashRing.get_node_hostnamec C s | j |d�S )zhReturns the port of the node matching the hashed key.
:param key: the key to look for.
r& )r3 )r r4 r
r
r �
get_node_port� s zHashRing.get_node_portc C s | j |d�S )zrReturns the index position of the node matching the hashed key.
:param key: the key to look for.
r; )r3 )r r4 r
r
r � get_node_pos� s zHashRing.get_node_posc C s | j |d�S )zjReturns the weight of the node matching the hashed key.
:param key: the key to look for.
r' )r3 )r r4 r
r
r �get_node_weight� s zHashRing.get_node_weightc C s | j jj� S )z8Returns a list of the names of all the configured nodes.)r r �keys)r r
r
r � get_nodes� s zHashRing.get_nodesc s � fdd�� j jD �S )z@Returns a ketama compatible list of (position, nodename) tuples.c s g | ]}|� j j| f�qS r
)r r= )r r )r r
r r@ � s z'HashRing.get_points.<locals>.<listcomp>)r r7 )r r
)r r �
get_points� s zHashRing.get_pointsc C s | j |d�S )zjReturns a ketama compatible (position, nodename) tuple.
:param key: the key to look for.
r< )r3 )r r4 r
r
r �
get_server� s zHashRing.get_serverTc c s6 | j jsdV n"x | j||d�D ]}|d V q W dS )ai hash_ring compatibility implementation.
Given a string key it returns the nodes as a generator that
can hold the key.
The generator iterates one time through the ring
starting at the correct position.
if `distinct` is set, then the nodes returned will be unique,
i.e. no virtual copies will be returned.
N)�uniquer% )r r= �range)r r4 Zdistinctr0 r
r
r �
iterate_nodes� s
zHashRing.iterate_nodesc C sZ t | jj�}|r td|� �� ntd� x,| j� D ] }|\}}t|� d|� d�� q2W dS )z,Prints a ketama compatible continuum report.zNumpoints in continuum: zContinuum emptyz (�)N)r8 r r7 �printrK )r Z numpointsr9 Zpointr0 r
r
r �print_continuum s zHashRing.print_continuumNc c s t � }|r |pt| jj�}ng }| j|�}x�| jj|d� D ]P}| jj| }|rf||krZq<|j|� n
|j|� | jj| V t|�|kr<P q<W xlt | jj�D ]\\}}||k r�| jj| }|r�||kr�q�|j|� n
|j|� | jj| V t|�|kr�P q�W dS )a Returns a generator of nodes' configuration available
in the continuum/ring.
:param key: the key to look for.
:param size: limit the list to at most this number of nodes.
:param unique: a node may only appear once in the list (default True).
N)
�setr8 r r r: r7 r= �add�append� enumerate)r r4 �sizerM Z all_nodesr; r% �ir
r
r rN s4
zHashRing.rangec C s | j j| j jj� � d S )N)r r r r )r r
r
r �
regenerate6 s zHashRing.regeneratec C s | j jS )N)r r )r r
r
r r1 9 s z
HashRing.confc C s | j jS )N)r Z
_distribution)r r
r
r � distribution? s zHashRing.distributionc C s | j jS )N)r r= )r r
r
r �ringC s z
HashRing.ringc C s t | jj�S )N)r8 r r= )r r
r
r rW I s z
HashRing.sizec C s | j jS )N)r r= )r r
r
r r= M s zHashRing._ringc C s | j jS )N)r r )r r
r
r r Q s zHashRing._nodesc C s | j jS )N)r r7 )r r
r
r r7 U s zHashRing._keys)T)NT)'�__name__�
__module__� __qualname__�__doc__r! r r2 Z remove_noder5 Zget_node_instancer6 Zadd_noder: r3 r rB rC rD rE rF rG rH rJ rK rL rO rR rN rY �propertyr1 r rZ r[ Z continuumrW r= r r7 r
r
r
r r sF !6
( r N)r Zuhashring.ring_ketamar Zuhashring.ring_metar r r
r
r
r �<module> s