|
This notebook was created by Jean de Dieu Nyandwi for the love of machine learning community. For any feedback, errors or suggestion, he can be reached on email (johnjw7084 at gmail dot com), Twitter, or LinkedIn.
Support Vector Machines (SVM) - Classification¶
Support Vector Machines are the type of supervised learning algorithms used for regression, classification and detecting outliers. SVMs are remarkably one of the powerful models in classical machine learning suited for handling complex and high dimensional datasets.
With SVM supporting different kernels (linear, polynomial, Radial Basis Function(rbf), and sigmoid), SVM can tackle different kinds of datasets, both linear and non linear.
While the maths behind the SVMs are beyond the scope of this notebook, here is the idea behind SVMs:
The way SVM works can be compared to a street with a boundary line. During SVM training, SMV draws the large margin or decision boundary between classes based on the importance of each training data point. The training data points that are inside the decision boundary are called support vectors and hence the name.
Image source: Wikimedia
We are going to use Iris flower dataset.The dataset contain 3 species which are: Iris Setosa, Iris Virginica, Iris Versicolor. These species are what we can refer to categories/classes. The features are sepal length, sepal width, petal length, petal width. All features were measured in centimeters(cm).
There are 50 samples for each specy, so we have 150 samples for all species. Below are the pictures of these 3 species.
In [85]:
Copied!
from IPython.display import Image
url_setosa = 'http://upload.wikimedia.org/wikipedia/commons/5/56/Kosaciec_szczecinkowaty_Iris_setosa.jpg'
url_virginica = 'http://upload.wikimedia.org/wikipedia/commons/9/9f/Iris_virginica.jpg'
url_versicolor = 'http://upload.wikimedia.org/wikipedia/commons/4/41/Iris_versicolor_3.jpg'
urls = [url_setosa, url_virginica,url_versicolor]
def display_image(url):
image = Image(url, width=250, height=200)
return image
from IPython.display import Image
url_setosa = 'http://upload.wikimedia.org/wikipedia/commons/5/56/Kosaciec_szczecinkowaty_Iris_setosa.jpg'
url_virginica = 'http://upload.wikimedia.org/wikipedia/commons/9/9f/Iris_virginica.jpg'
url_versicolor = 'http://upload.wikimedia.org/wikipedia/commons/4/41/Iris_versicolor_3.jpg'
urls = [url_setosa, url_virginica,url_versicolor]
def display_image(url):
image = Image(url, width=250, height=200)
return image
In [86]:
Copied!
# Displaying Iris Setosa
display_image(urls[0])
# Displaying Iris Setosa
display_image(urls[0])
Out[86]:
In [87]:
Copied!
# Displaying Iris Virginica
display_image(urls[1])
# Displaying Iris Virginica
display_image(urls[1])
Out[87]:
In [88]:
Copied!
# Displaying Iris Versicolor
display_image(urls[2])
# Displaying Iris Versicolor
display_image(urls[2])
Out[88]:
1 - Imports¶
In [89]:
Copied!
import numpy as np
import pandas as pd
import seaborn as sns
import sklearn
import matplotlib.pyplot as plt
%matplotlib inline
import numpy as np
import pandas as pd
import seaborn as sns
import sklearn
import matplotlib.pyplot as plt
%matplotlib inline
2 - Loading the data¶
We will get Iris data from Sklearn datasets. Setting as_frame parameter to True will return data as a Pandas Dataframe.
In [90]:
Copied!
from sklearn.datasets import load_iris
X, y = load_iris(return_X_y=True, as_frame=True)
from sklearn.datasets import load_iris
X, y = load_iris(return_X_y=True, as_frame=True)
In [91]:
Copied!
X.info()
X.info()
<class 'pandas.core.frame.DataFrame'> RangeIndex: 150 entries, 0 to 149 Data columns (total 4 columns): # Column Non-Null Count Dtype --- ------ -------------- ----- 0 sepal length (cm) 150 non-null float64 1 sepal width (cm) 150 non-null float64 2 petal length (cm) 150 non-null float64 3 petal width (cm) 150 non-null float64 dtypes: float64(4) memory usage: 4.8 KB
In [92]:
Copied!
X.head()
X.head()
Out[92]:
| sepal length (cm) | sepal width (cm) | petal length (cm) | petal width (cm) | |
|---|---|---|---|---|
| 0 | 5.1 | 3.5 | 1.4 | 0.2 |
| 1 | 4.9 | 3.0 | 1.4 | 0.2 |
| 2 | 4.7 | 3.2 | 1.3 | 0.2 |
| 3 | 4.6 | 3.1 | 1.5 | 0.2 |
| 4 | 5.0 | 3.6 | 1.4 | 0.2 |
In [93]:
Copied!
y.head()
y.head()
Out[93]:
0 0 1 0 2 0 3 0 4 0 Name: target, dtype: int64
3 - Exploratory Analysis¶
Before exploring some insight in data, let's split it into test and train set.
In [94]:
Copied!
from sklearn.model_selection import train_test_split
X_train, X_test, y_train, y_test = train_test_split(X,y, test_size=0.2,random_state=20)
print('The size of training data is: {} \nThe size of testing data is: {}'.format(len(X_train), len(X_test)))
from sklearn.model_selection import train_test_split
X_train, X_test, y_train, y_test = train_test_split(X,y, test_size=0.2,random_state=20)
print('The size of training data is: {} \nThe size of testing data is: {}'.format(len(X_train), len(X_test)))
The size of training data is: 120 The size of testing data is: 30
In [95]:
Copied!
# Three species
y_train.value_counts()
# Three species
y_train.value_counts()
Out[95]:
0 42 1 39 2 39 Name: target, dtype: int64
Plotting the histograms of all 4 features
In [96]:
Copied!
X_train.hist(bins=30, figsize=(20,15))
plt.show()
X_train.hist(bins=30, figsize=(20,15))
plt.show()
Plotting the scatter plots of the features
In [97]:
Copied!
sns.scatterplot(data=X_train, x='sepal length (cm)', y='sepal width (cm)', hue=y_train)
sns.scatterplot(data=X_train, x='sepal length (cm)', y='sepal width (cm)', hue=y_train)
Out[97]:
<AxesSubplot:xlabel='sepal length (cm)', ylabel='sepal width (cm)'>
In [98]:
Copied!
sns.scatterplot(data=X_train, x='petal length (cm)', y='petal width (cm)', hue=y_train)
sns.scatterplot(data=X_train, x='petal length (cm)', y='petal width (cm)', hue=y_train)
Out[98]:
<AxesSubplot:xlabel='petal length (cm)', ylabel='petal width (cm)'>
4 - Data Preprocessing¶
The features already have small values but let's scale them to be between 0 and 1. SVM work well with scaled values. I will set up a pipeline to handle that.
In [99]:
Copied!
X_train.max()
X_train.max()
Out[99]:
sepal length (cm) 7.9 sepal width (cm) 4.4 petal length (cm) 6.9 petal width (cm) 2.5 dtype: float64
In [100]:
Copied!
from sklearn.pipeline import Pipeline
from sklearn.preprocessing import MinMaxScaler
scale_pipe = Pipeline([
('scaler', MinMaxScaler())
])
X_train_scaled = scale_pipe.fit_transform(X_train)
from sklearn.pipeline import Pipeline
from sklearn.preprocessing import MinMaxScaler
scale_pipe = Pipeline([
('scaler', MinMaxScaler())
])
X_train_scaled = scale_pipe.fit_transform(X_train)
5 - Training Support Vector Classifier¶
We are going to train two classifiers: Linear SVC and SVC that we can use different kernels. SVM supports linear, polynomial, sigmoid and rbf kernels.
In [101]:
Copied!
from sklearn.svm import LinearSVC, SVC
lin_svc = LinearSVC()
lin_svc.fit(X_train_scaled, y_train)
from sklearn.svm import LinearSVC, SVC
lin_svc = LinearSVC()
lin_svc.fit(X_train_scaled, y_train)
Out[101]:
LinearSVC()
In [102]:
Copied!
poly_svc = SVC(kernel='poly')
poly_svc.fit(X_train_scaled, y_train)
poly_svc = SVC(kernel='poly')
poly_svc.fit(X_train_scaled, y_train)
Out[102]:
SVC(kernel='poly')
6 - Evaluating Support Vector Classifier¶
Let's first check the accuracy on the training. For this step since we are trying to find model to improve further, we won't touch test set yet.
In [103]:
Copied!
from sklearn.metrics import accuracy_score
lin_pred = lin_svc.predict(X_train_scaled)
accuracy_score(y_train, lin_pred)
from sklearn.metrics import accuracy_score
lin_pred = lin_svc.predict(X_train_scaled)
accuracy_score(y_train, lin_pred)
Out[103]:
0.95
In [104]:
Copied!
from sklearn.metrics import accuracy_score
poly_pred = poly_svc.predict(X_train_scaled)
accuracy_score(y_train, poly_pred)
from sklearn.metrics import accuracy_score
poly_pred = poly_svc.predict(X_train_scaled)
accuracy_score(y_train, poly_pred)
Out[104]:
0.9833333333333333
We can also display the confusion matrix and the classification report on SVC with polynomial kernel. Classification report goes beyond accuracy to recall, precision, and f1 score.
In [105]:
Copied!
from sklearn.metrics import confusion_matrix, classification_report
confusion_matrix(y_train, poly_pred)
from sklearn.metrics import confusion_matrix, classification_report
confusion_matrix(y_train, poly_pred)
Out[105]:
array([[42, 0, 0],
[ 0, 37, 2],
[ 0, 0, 39]])
In [106]:
Copied!
print(classification_report(y_train, poly_pred))
print(classification_report(y_train, poly_pred))
precision recall f1-score support
0 1.00 1.00 1.00 42
1 1.00 0.95 0.97 39
2 0.95 1.00 0.97 39
accuracy 0.98 120
macro avg 0.98 0.98 0.98 120
weighted avg 0.98 0.98 0.98 120
The results are quite impressive given that we didn't have to tune any hyper paremeter. Although this would be enough for our dataset, it's unlikely that your model will work well at first in real life. You may have to tune hyperparamaters.
There are two commom techniques for hyper parameter search. These are Randomized Search and GridSearch. In our last, we used Randomized Search, let's use GridSearch now.
7 - Improving Support Vector Classifier¶
In [107]:
Copied!
from sklearn.model_selection import GridSearchCV
params_grid = {'C':[0.001,10,100,1000],
'gamma':[1,0.1,0.01,0.001],
'degree':[2,3,4,5],
'coef0':[0,1,2,4]
}
grid_search = GridSearchCV(SVC('poly'), params_grid, verbose=2)
grid_search.fit(X_train_scaled, y_train)
from sklearn.model_selection import GridSearchCV
params_grid = {'C':[0.001,10,100,1000],
'gamma':[1,0.1,0.01,0.001],
'degree':[2,3,4,5],
'coef0':[0,1,2,4]
}
grid_search = GridSearchCV(SVC('poly'), params_grid, verbose=2)
grid_search.fit(X_train_scaled, y_train)
Fitting 5 folds for each of 256 candidates, totalling 1280 fits [CV] END ................C=0.001, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=4, gamma=0.01; total time= 0.0s
/Users/jean/opt/miniconda3/envs/tensor/lib/python3.7/site-packages/sklearn/utils/validation.py:72: FutureWarning: Pass C=poly as keyword args. From version 1.0 (renaming of 0.25) passing these as positional arguments will result in an error "will result in an error", FutureWarning)
[CV] END .............C=0.001, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END ................C=0.001, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=0.001, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=0.001, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END ............C=0.001, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=10, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=10, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=10, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=10, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=10, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=10, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=10, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=10, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=10, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=10, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=10, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=10, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=10, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=10, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=10, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END ...................C=10, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END .................C=10, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=10, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END ................C=10, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END ...............C=10, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END ..................C=100, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END ................C=100, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END ...............C=100, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END ..............C=100, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=2, gamma=1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=2, gamma=0.001; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=3, gamma=1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=3, gamma=0.001; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=4, gamma=1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=4, gamma=0.001; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=0, degree=5, gamma=1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=0, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=0, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=0, degree=5, gamma=0.001; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=2, gamma=1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=2, gamma=0.001; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=3, gamma=1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=3, gamma=0.001; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=4, gamma=1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=4, gamma=0.001; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=1, degree=5, gamma=1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=1, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=1, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=1, degree=5, gamma=0.001; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=2, gamma=1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=2, gamma=0.001; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=3, gamma=1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=3, gamma=0.001; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=4, gamma=1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=4, gamma=0.001; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=2, degree=5, gamma=1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=2, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=2, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=2, degree=5, gamma=0.001; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=2, gamma=1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=2, gamma=0.1; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=2, gamma=0.01; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=2, gamma=0.001; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=3, gamma=1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=3, gamma=0.1; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=3, gamma=0.01; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=3, gamma=0.001; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=4, gamma=1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=4, gamma=0.1; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=4, gamma=0.01; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=4, gamma=0.001; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END .................C=1000, coef0=4, degree=5, gamma=1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END ...............C=1000, coef0=4, degree=5, gamma=0.1; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END ..............C=1000, coef0=4, degree=5, gamma=0.01; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=5, gamma=0.001; total time= 0.0s [CV] END .............C=1000, coef0=4, degree=5, gamma=0.001; total time= 0.0s
Out[107]:
GridSearchCV(estimator=SVC(C='poly'),
param_grid={'C': [0.001, 10, 100, 1000], 'coef0': [0, 1, 2, 4],
'degree': [2, 3, 4, 5],
'gamma': [1, 0.1, 0.01, 0.001]},
verbose=2)
In [108]:
Copied!
grid_search.best_params_
grid_search.best_params_
Out[108]:
{'C': 10, 'coef0': 0, 'degree': 2, 'gamma': 0.1}
In [109]:
Copied!
# In grid search definition above, if you set parameter re_fit to True, you won't have to do this
poly_best = grid_search.best_estimator_.fit(X_train_scaled, y_train)
# In grid search definition above, if you set parameter re_fit to True, you won't have to do this
poly_best = grid_search.best_estimator_.fit(X_train_scaled, y_train)
In [110]:
Copied!
grid_pred = poly_best.predict(X_train_scaled)
grid_pred = poly_best.predict(X_train_scaled)
In [111]:
Copied!
accuracy_score(y_train, grid_pred)
accuracy_score(y_train, grid_pred)
Out[111]:
0.9833333333333333
In [112]:
Copied!
confusion_matrix(y_train, grid_pred)
confusion_matrix(y_train, grid_pred)
Out[112]:
array([[42, 0, 0],
[ 0, 39, 0],
[ 0, 2, 37]])
In [113]:
Copied!
print(classification_report(y_train, grid_pred))
print(classification_report(y_train, grid_pred))
precision recall f1-score support
0 1.00 1.00 1.00 42
1 0.95 1.00 0.97 39
2 1.00 0.95 0.97 39
accuracy 0.98 120
macro avg 0.98 0.98 0.98 120
weighted avg 0.98 0.98 0.98 120
As you can see, nothing really improved. This was only for purpose of learning how to improve a model, tuning hyperparameters per the reason that most of the time the first model will not be good enough.
After your have improved your model, you can safely make predictions on test set. We will have to scale it first, just like we did for the training set. Recall that we don't do fit_transform, we only transfrom the test set.
In [114]:
Copied!
test_scaled = scale_pipe.transform(X_test)
test_scaled = scale_pipe.transform(X_test)
In [115]:
Copied!
test_pred = poly_best.predict(test_scaled)
test_pred = poly_best.predict(test_scaled)
In [116]:
Copied!
accuracy_score(y_test, test_pred)
accuracy_score(y_test, test_pred)
Out[116]:
0.9333333333333333
In [117]:
Copied!
print(classification_report(y_test, test_pred))
print(classification_report(y_test, test_pred))
precision recall f1-score support
0 1.00 1.00 1.00 8
1 0.85 1.00 0.92 11
2 1.00 0.82 0.90 11
accuracy 0.93 30
macro avg 0.95 0.94 0.94 30
weighted avg 0.94 0.93 0.93 30
Let's see why we didn't have to tune hyperparameters. If we evaluate our first good model before the hyperparameter search, you can see that it does well on the test set than the one with tuned hyperparameter.
What does that tell us? It means that when we were trying to improve the model, we were actually overfitting and as the results the model can not generalize well on the new data. If you look on above results, that's what happened.
Let's evauate our first polynomial model on the test set. It was pretty good even without hyperparameter tuning because the accuracy on train was 98%.
In [118]:
Copied!
test_pred_poly = poly_svc.predict(test_scaled)
test_pred_poly = poly_svc.predict(test_scaled)
In [119]:
Copied!
accuracy_score(y_test, test_pred_poly)
accuracy_score(y_test, test_pred_poly)
Out[119]:
0.9666666666666667
In [120]:
Copied!
print(classification_report(y_test, test_pred_poly))
print(classification_report(y_test, test_pred_poly))
precision recall f1-score support
0 1.00 1.00 1.00 8
1 0.92 1.00 0.96 11
2 1.00 0.91 0.95 11
accuracy 0.97 30
macro avg 0.97 0.97 0.97 30
weighted avg 0.97 0.97 0.97 30
This is the end of the lab which was all about using Support Vector Machines for classification task. As you can see, SVM is a robust algorithm given how it supports different kernels. These kernels are what make it suitable for both linear and non linear problems. In real world, many datasets are not linear. So when you can't get good results with linear models, try things like SVM with polynomial kernel.
In [ ]:
Copied!